[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:10 dist-test-slave-ltw5 krb5kdc[15997](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:10 dist-test-slave-ltw5 krb5kdc[15997](info): set up 2 sockets
Sep 29 06:38:10 dist-test-slave-ltw5 krb5kdc[15997](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260929 06:38:11.103997 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[15997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:38:11.225633 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:38085
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:38085
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:11.304652 16010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:11.304857 16010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:11.304878 16010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:11.306000 16010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:11.306059 16010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:11.306074 16010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:11.306087 16010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:11.306098 16010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:11.307554 16010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:38085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:38085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:11.307739 16010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:11.307904 16010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:11.313058 16015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:11.313082 16016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:11.313189 16010 server_base.cc:1034] running on GCE node
W20260929 06:38:11.314185 16018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:11.314457 16010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:11.314793 16010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:11.315976 16010 hybrid_clock.cc:648] HybridClock initialized: now 1790663891315963 us; error 45 us; skew 500 ppm
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[15997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663891, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:11.318630 16010 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:38:11.319101 16010 webserver.cc:460] Webserver started at http://127.15.157.190:41151/ using document root <none> and password file <none>
I20260929 06:38:11.319376 16010 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:11.319448 16010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:11.319599 16010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:11.320711 16010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "e21935da121540d48dd45a4a276bf8f0"
format_stamp: "Formatted at 2026-09-29 06:38:11 on dist-test-slave-ltw5"
server_key: "39f67719b99f267ae3867b16253fdf14"
server_key_iv: "a9efd43b32b6ce07b8c1e5c8a635da03"
server_key_version: "encryptionkey@0"
I20260929 06:38:11.321112 16010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "e21935da121540d48dd45a4a276bf8f0"
format_stamp: "Formatted at 2026-09-29 06:38:11 on dist-test-slave-ltw5"
server_key: "39f67719b99f267ae3867b16253fdf14"
server_key_iv: "a9efd43b32b6ce07b8c1e5c8a635da03"
server_key_version: "encryptionkey@0"
I20260929 06:38:11.322737 16010 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:38:11.323511 16025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:11.323815 16010 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:11.323915 16010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "e21935da121540d48dd45a4a276bf8f0"
format_stamp: "Formatted at 2026-09-29 06:38:11 on dist-test-slave-ltw5"
server_key: "39f67719b99f267ae3867b16253fdf14"
server_key_iv: "a9efd43b32b6ce07b8c1e5c8a635da03"
server_key_version: "encryptionkey@0"
I20260929 06:38:11.324052 16010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:11.336781 16010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:11.339103 16010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:11.339264 16010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:11.343101 16010 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:38085
I20260929 06:38:11.343133 16077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:38085 every 8 connection(s)
I20260929 06:38:11.343505 16010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:11.344466 16078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:11.346822 16078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0: Bootstrap starting.
I20260929 06:38:11.347430 16078 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:11.347716 16078 log.cc:824] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:11.348491 16078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0: No bootstrap required, opened a new log
I20260929 06:38:11.350063 16078 raft_consensus.cc:348] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e21935da121540d48dd45a4a276bf8f0" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38085 } }
I20260929 06:38:11.350277 16078 raft_consensus.cc:374] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:11.350315 16078 raft_consensus.cc:729] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e21935da121540d48dd45a4a276bf8f0, State: Initialized, Role: FOLLOWER
I20260929 06:38:11.350452 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 16010
I20260929 06:38:11.350466 16078 consensus_queue.cc:260] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e21935da121540d48dd45a4a276bf8f0" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38085 } }
I20260929 06:38:11.350538 16078 raft_consensus.cc:388] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:11.350559 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:11.350571 16078 raft_consensus.cc:482] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:11.350618 16078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:11.351292 16078 raft_consensus.cc:504] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e21935da121540d48dd45a4a276bf8f0" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38085 } }
I20260929 06:38:11.351339 15990 external_mini_cluster.cc:1428] Setting key 13dc5d3393b50c50c9ac513c0f15f53e
I20260929 06:38:11.351404 16078 leader_election.cc:302] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e21935da121540d48dd45a4a276bf8f0; no voters:
I20260929 06:38:11.351573 16078 leader_election.cc:288] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:11.351610 16081 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:11.351780 16081 raft_consensus.cc:686] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [term 1 LEADER]: Becoming Leader. State: Replica: e21935da121540d48dd45a4a276bf8f0, State: Running, Role: LEADER
I20260929 06:38:11.351814 16078 sys_catalog.cc:564] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:11.351884 16081 consensus_queue.cc:237] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e21935da121540d48dd45a4a276bf8f0" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38085 } }
I20260929 06:38:11.352203 16081 sys_catalog.cc:455] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e21935da121540d48dd45a4a276bf8f0. Latest consensus state: current_term: 1 leader_uuid: "e21935da121540d48dd45a4a276bf8f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e21935da121540d48dd45a4a276bf8f0" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38085 } } }
I20260929 06:38:11.352283 16081 sys_catalog.cc:458] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:11.352445 16083 sys_catalog.cc:455] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e21935da121540d48dd45a4a276bf8f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e21935da121540d48dd45a4a276bf8f0" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38085 } } }
I20260929 06:38:11.352558 16083 sys_catalog.cc:458] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:11.353504 16087 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:11.354000 16087 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:11.356019 16087 catalog_manager.cc:1347] Generated new cluster ID: 6b6752f157e14aa1bafefe8d1ba5eedb
I20260929 06:38:11.356076 16087 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:11.361027 16087 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:11.362373 16087 catalog_manager.cc:1504] Loading token signing keys...
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[15997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:11.365586 16087 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e21935da121540d48dd45a4a276bf8f0: Generated new TSK 0
I20260929 06:38:11.365757 16087 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:38:11.368737 16093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:11.352821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60228 (local address 127.15.157.190:38085)
0929 06:38:11.353669 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:11.353677 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:11.353711 (+ 34us) server_negotiation.cc:407] Connection header received
0929 06:38:11.355033 (+ 1322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:11.355040 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:11.355095 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:11.355239 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:11.356982 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.358010 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.359075 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.359568 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.359729 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:11.364689 (+ 4960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:11.364694 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:11.364694 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:11.364706 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:11.366902 (+ 2196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:11.367305 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:11.367308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:11.367308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:11.367431 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:11.367668 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:11.367668 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:11.367669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:11.367935 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:11.368075 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:11.368296 (+ 221us) server_negotiation.cc:299] Negotiation successful
0929 06:38:11.368453 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":802,"thread_start_us":130,"threads_started":1}
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:38:11.397545 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38085
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:11.482853 16104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:11.483052 16104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:11.483075 16104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:11.484200 16104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:11.484241 16104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:11.484267 16104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:11.485711 16104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38085
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:11.485956 16104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:11.486224 16104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:11.491153 16109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:11.491168 16110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:11.491153 16112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:11.491906 16104 server_base.cc:1034] running on GCE node
I20260929 06:38:11.492174 16104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:11.492436 16104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:11.493593 16104 hybrid_clock.cc:648] HybridClock initialized: now 1790663891493577 us; error 34 us; skew 500 ppm
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[15997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663891, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:11.496268 16104 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:38:11.496784 16104 webserver.cc:460] Webserver started at http://127.15.157.129:40841/ using document root <none> and password file <none>
I20260929 06:38:11.497041 16104 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:11.497094 16104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:11.497221 16104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:11.498618 16104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "4065271980d04f3e96419c5c9bee265f"
format_stamp: "Formatted at 2026-09-29 06:38:11 on dist-test-slave-ltw5"
server_key: "5058b041e431eda4bf2829cc8d895e3e"
server_key_iv: "f4ca6a9a22612cf769a87e16e0a212d3"
server_key_version: "encryptionkey@0"
I20260929 06:38:11.498994 16104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "4065271980d04f3e96419c5c9bee265f"
format_stamp: "Formatted at 2026-09-29 06:38:11 on dist-test-slave-ltw5"
server_key: "5058b041e431eda4bf2829cc8d895e3e"
server_key_iv: "f4ca6a9a22612cf769a87e16e0a212d3"
server_key_version: "encryptionkey@0"
I20260929 06:38:11.500484 16104 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:11.501336 16119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:11.501552 16104 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:11.501667 16104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "4065271980d04f3e96419c5c9bee265f"
format_stamp: "Formatted at 2026-09-29 06:38:11 on dist-test-slave-ltw5"
server_key: "5058b041e431eda4bf2829cc8d895e3e"
server_key_iv: "f4ca6a9a22612cf769a87e16e0a212d3"
server_key_version: "encryptionkey@0"
I20260929 06:38:11.501736 16104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:11.523094 16104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:11.525198 16104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:11.525359 16104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:11.525604 16104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:11.525928 16104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:11.525980 16104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:11.526021 16104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:11.526083 16104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:11.531878 16104 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:34027
I20260929 06:38:11.531922 16232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:34027 every 8 connection(s)
I20260929 06:38:11.532255 16104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:38:11.532677 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 16104
I20260929 06:38:11.532787 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:38:11.532996 15990 external_mini_cluster.cc:1428] Setting key 7a729a6bce1bc78e950203e6a7a37414
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[15997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663891, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
I20260929 06:38:11.541985 16093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:11.533142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:45165 (local address 127.15.157.190:38085)
0929 06:38:11.533213 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:11.533215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:11.533601 (+ 386us) server_negotiation.cc:407] Connection header received
0929 06:38:11.534197 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:11.534198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:11.534209 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:11.534263 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:11.535187 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.535684 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.536704 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.536924 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.537008 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:11.539168 (+ 2160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:11.539170 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:11.539170 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:11.539178 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:11.540571 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:11.541004 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:11.541005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:11.541006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:11.541067 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:11.541324 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:11.541325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:11.541325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:11.541444 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:11.541523 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:11.541792 (+ 269us) server_negotiation.cc:299] Negotiation successful
0929 06:38:11.541880 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 06:38:11.542198 16235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:11.533049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38085 (local address 127.15.157.129:45165)
0929 06:38:11.533444 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:11.533491 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:11.534090 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:11.534333 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:11.534337 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:11.534901 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:11.535087 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:11.535092 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.535780 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.535781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:11.536608 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:11.536610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.537013 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.537014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:11.537148 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:11.537686 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:11.537694 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:11.539075 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:11.540670 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:11.540677 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:11.540679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:11.540897 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:11.541144 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:11.541144 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:11.541145 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:11.541251 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:11.541513 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:11.541519 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:11.541660 (+ 141us) client_negotiation.cc:769] Sending connection context
0929 06:38:11.541771 (+ 111us) client_negotiation.cc:240] Negotiation successful
0929 06:38:11.541919 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":94,"threads_started":1}
I20260929 06:38:11.542703 16233 heartbeater.cc:347] Connected to a master server at 127.15.157.190:38085
I20260929 06:38:11.542783 16233 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:11.542969 16233 heartbeater.cc:511] Master 127.15.157.190:38085 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
I20260929 06:38:11.543737 16042 ts_manager.cc:194] Registered new tserver with Master: 4065271980d04f3e96419c5c9bee265f (127.15.157.129:34027)
I20260929 06:38:11.544667 16042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:45165
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:38:11.560518 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38085
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:11.643621 16238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:11.643811 16238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:11.643834 16238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:11.645018 16238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:11.645059 16238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:11.645087 16238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:11.646477 16238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38085
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:11.646653 16238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:11.646818 16238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:11.651742 16246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:11.651746 16243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:11.651764 16244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:11.651815 16238 server_base.cc:1034] running on GCE node
I20260929 06:38:11.652155 16238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:11.652472 16238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:11.653623 16238 hybrid_clock.cc:648] HybridClock initialized: now 1790663891653608 us; error 34 us; skew 500 ppm
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[15997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663891, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:11.656061 16238 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:38:11.656543 16238 webserver.cc:460] Webserver started at http://127.15.157.130:41425/ using document root <none> and password file <none>
I20260929 06:38:11.656739 16238 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:11.656780 16238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:11.656863 16238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:11.657831 16238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "a0260cbd5831428881136283cbd218ca"
format_stamp: "Formatted at 2026-09-29 06:38:11 on dist-test-slave-ltw5"
server_key: "df97d5a5a2e6a022a3884745c6566a44"
server_key_iv: "6ff96269a1e65f33e71454f02812b8c8"
server_key_version: "encryptionkey@0"
I20260929 06:38:11.658205 16238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "a0260cbd5831428881136283cbd218ca"
format_stamp: "Formatted at 2026-09-29 06:38:11 on dist-test-slave-ltw5"
server_key: "df97d5a5a2e6a022a3884745c6566a44"
server_key_iv: "6ff96269a1e65f33e71454f02812b8c8"
server_key_version: "encryptionkey@0"
I20260929 06:38:11.659449 16238 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:11.660141 16253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:11.660310 16238 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:11.660408 16238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "a0260cbd5831428881136283cbd218ca"
format_stamp: "Formatted at 2026-09-29 06:38:11 on dist-test-slave-ltw5"
server_key: "df97d5a5a2e6a022a3884745c6566a44"
server_key_iv: "6ff96269a1e65f33e71454f02812b8c8"
server_key_version: "encryptionkey@0"
I20260929 06:38:11.660498 16238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:11.668757 16238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:11.670755 16238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:11.670910 16238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:11.671123 16238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:11.671406 16238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:11.671460 16238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:11.671500 16238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:11.671527 16238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:11.678453 16238 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:42421
I20260929 06:38:11.678501 16366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:42421 every 8 connection(s)
I20260929 06:38:11.678819 16238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[15997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663891, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:11.685283 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 16238
I20260929 06:38:11.685410 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:38:11.685591 15990 external_mini_cluster.cc:1428] Setting key f5bdff8f88cc8a0889a26d6fec7c406e
I20260929 06:38:11.688139 16093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:11.679678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:59149 (local address 127.15.157.190:38085)
0929 06:38:11.679750 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:11.679753 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:11.679964 (+ 211us) server_negotiation.cc:407] Connection header received
0929 06:38:11.680386 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:11.680387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:11.680396 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:11.680450 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:11.681336 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.681810 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.682800 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.682995 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.683048 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:11.685037 (+ 1989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:11.685038 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:11.685039 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:11.685046 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:11.686604 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:11.687101 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:11.687102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:11.687102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:11.687151 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:11.687415 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:11.687416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:11.687416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:11.687527 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:11.687605 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:11.687955 (+ 350us) server_negotiation.cc:299] Negotiation successful
0929 06:38:11.688040 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 06:38:11.688334 16369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:11.679630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38085 (local address 127.15.157.130:59149)
0929 06:38:11.679800 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:11.679866 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:11.680305 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:11.680503 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:11.680506 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:11.681073 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:11.681264 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:11.681268 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.681926 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.681927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:11.682730 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:11.682732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.683065 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.683065 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:11.683165 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:11.683598 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:11.683606 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:11.684928 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:11.686685 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:11.686691 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:11.686693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:11.687029 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:11.687215 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:11.687216 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:11.687216 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:11.687352 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:11.687600 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:11.687606 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:11.687782 (+ 176us) client_negotiation.cc:769] Sending connection context
0929 06:38:11.687911 (+ 129us) client_negotiation.cc:240] Negotiation successful
0929 06:38:11.688079 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":95,"threads_started":1}
I20260929 06:38:11.688890 16367 heartbeater.cc:347] Connected to a master server at 127.15.157.190:38085
I20260929 06:38:11.688985 16367 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:11.689164 16367 heartbeater.cc:511] Master 127.15.157.190:38085 requested a full tablet report, sending...
I20260929 06:38:11.689505 16042 ts_manager.cc:194] Registered new tserver with Master: a0260cbd5831428881136283cbd218ca (127.15.157.130:42421)
I20260929 06:38:11.689872 16042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:59149
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:38:11.710867 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38085
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:11.792785 16372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:11.792984 16372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:11.793006 16372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:11.794087 16372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:11.794121 16372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:11.794147 16372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:11.795495 16372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38085
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:11.795665 16372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:11.795854 16372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:11.800876 16378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:11.800904 16380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:11.800876 16377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:11.801071 16372 server_base.cc:1034] running on GCE node
I20260929 06:38:11.801290 16372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:11.801494 16372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:11.802628 16372 hybrid_clock.cc:648] HybridClock initialized: now 1790663891802615 us; error 28 us; skew 500 ppm
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[15997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663891, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:11.805051 16372 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:38:11.805536 16372 webserver.cc:460] Webserver started at http://127.15.157.131:46681/ using document root <none> and password file <none>
I20260929 06:38:11.805724 16372 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:11.805763 16372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:11.805850 16372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:11.806859 16372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "f723b70d2c9747f39fb3428b5c8b75b5"
format_stamp: "Formatted at 2026-09-29 06:38:11 on dist-test-slave-ltw5"
server_key: "93ceb2657b17d8018e1110de1e47015b"
server_key_iv: "e8a856212b7846a5ccb886d0fed808e5"
server_key_version: "encryptionkey@0"
I20260929 06:38:11.807166 16372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "f723b70d2c9747f39fb3428b5c8b75b5"
format_stamp: "Formatted at 2026-09-29 06:38:11 on dist-test-slave-ltw5"
server_key: "93ceb2657b17d8018e1110de1e47015b"
server_key_iv: "e8a856212b7846a5ccb886d0fed808e5"
server_key_version: "encryptionkey@0"
I20260929 06:38:11.808349 16372 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:38:11.809105 16387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:11.809270 16372 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:11.809337 16372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "f723b70d2c9747f39fb3428b5c8b75b5"
format_stamp: "Formatted at 2026-09-29 06:38:11 on dist-test-slave-ltw5"
server_key: "93ceb2657b17d8018e1110de1e47015b"
server_key_iv: "e8a856212b7846a5ccb886d0fed808e5"
server_key_version: "encryptionkey@0"
I20260929 06:38:11.809429 16372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:11.836617 16372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:11.838824 16372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:11.838966 16372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:11.839234 16372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:11.839556 16372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:11.839591 16372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:11.839613 16372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:11.839658 16372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:11.846071 16372 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:33673
I20260929 06:38:11.846097 16500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:33673 every 8 connection(s)
I20260929 06:38:11.846423 16372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[15997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663891, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:11.855986 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 16372
I20260929 06:38:11.856096 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:38:11.856292 15990 external_mini_cluster.cc:1428] Setting key b9e4984f513df22ba43b3af4346d2b71
I20260929 06:38:11.856465 16093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:11.847211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:45191 (local address 127.15.157.190:38085)
0929 06:38:11.847285 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:11.847303 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:11.847494 (+ 191us) server_negotiation.cc:407] Connection header received
0929 06:38:11.848058 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:11.848060 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:11.848073 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:11.848121 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:11.849108 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.849617 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.850703 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.850902 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.851015 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:11.853494 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:11.853495 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:11.853496 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:11.853504 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:11.855062 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:11.855433 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:11.855434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:11.855434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:11.855488 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:11.855710 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:11.855711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:11.855711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:11.855867 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:11.855926 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:11.856266 (+ 340us) server_negotiation.cc:299] Negotiation successful
0929 06:38:11.856363 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 06:38:11.856670 16503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:11.847196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38085 (local address 127.15.157.131:45191)
0929 06:38:11.847360 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:11.847407 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:11.847943 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:11.848205 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:11.848210 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:11.848796 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:11.849004 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:11.849008 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.849714 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.849715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:11.850607 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:11.850609 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.851021 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.851023 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:11.851149 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:11.851772 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:11.851780 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:11.853387 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:11.855140 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:11.855146 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:11.855148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:11.855363 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:11.855548 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:11.855548 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:11.855549 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:11.855642 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:11.855940 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:11.855946 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:11.856127 (+ 181us) client_negotiation.cc:769] Sending connection context
0929 06:38:11.856248 (+ 121us) client_negotiation.cc:240] Negotiation successful
0929 06:38:11.856416 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260929 06:38:11.857141 16501 heartbeater.cc:347] Connected to a master server at 127.15.157.190:38085
I20260929 06:38:11.857267 16501 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:11.857476 16501 heartbeater.cc:511] Master 127.15.157.190:38085 requested a full tablet report, sending...
I20260929 06:38:11.857929 16042 ts_manager.cc:194] Registered new tserver with Master: f723b70d2c9747f39fb3428b5c8b75b5 (127.15.157.131:33673)
I20260929 06:38:11.858355 16042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:45191
I20260929 06:38:11.868786 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[15997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663891, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[15997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663891, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.157.129@KRBTEST.COM
I20260929 06:38:11.892016 16508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:11.884449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44976 (local address 127.15.157.129:34027)
0929 06:38:11.884622 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:11.884627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:11.884638 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:38:11.884664 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:11.884666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:11.884679 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:11.884747 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:11.885315 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.886087 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.886776 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.887104 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.887163 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:11.889371 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:11.889378 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:11.889378 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:11.889385 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:11.891039 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:11.891342 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:11.891345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:11.891345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:11.891396 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:11.891551 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:11.891552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:11.891552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:11.891670 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:11.891776 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:11.891830 (+ 54us) server_negotiation.cc:299] Negotiation successful
0929 06:38:11.891888 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":91,"threads_started":1}
W20260929 06:38:11.892458 16147 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44976
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[15997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[15997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.129@KRBTEST.COM
I20260929 06:38:11.915103 16508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:11.907468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44992 (local address 127.15.157.129:34027)
0929 06:38:11.907534 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:11.907536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:11.907673 (+ 137us) server_negotiation.cc:407] Connection header received
0929 06:38:11.907721 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:11.907721 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:11.907733 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:11.907796 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:11.908343 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.908817 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.909591 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:11.909785 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:11.909838 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:11.912508 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:11.912509 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:11.912509 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:11.912516 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:11.913924 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:11.914303 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:11.914304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:11.914304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:11.914356 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:11.914558 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:11.914560 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:11.914560 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:11.914669 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:11.914769 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:11.914878 (+ 109us) server_negotiation.cc:299] Negotiation successful
0929 06:38:11.914941 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 06:38:11.915691 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 16104
I20260929 06:38:11.922582 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 16238
I20260929 06:38:11.926957 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 16372
I20260929 06:38:11.930989 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 16010
2026-09-29T06:38:11Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (1880 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[16515](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[16515](info): set up 2 sockets
Sep 29 06:38:11 dist-test-slave-ltw5 krb5kdc[16515](info): commencing operation
krb5kdc: starting...
W20260929 06:38:12.989619 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[16515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:38:13.108789 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45405
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:36633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:45405
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:13.188331 16528 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:13.188544 16528 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:13.188566 16528 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:13.189636 16528 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:13.189671 16528 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:13.189685 16528 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:13.189697 16528 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:13.189709 16528 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:13.191133 16528 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:36633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:45405
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16528
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:13.191398 16528 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:13.191604 16528 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:13.196523 16533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:13.196609 16536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:13.196657 16534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:13.197086 16528 server_base.cc:1034] running on GCE node
I20260929 06:38:13.197335 16528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:13.197628 16528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:13.198807 16528 hybrid_clock.cc:648] HybridClock initialized: now 1790663893198782 us; error 56 us; skew 500 ppm
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[16515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663893, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:13.201464 16528 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:38:13.201983 16528 webserver.cc:460] Webserver started at http://127.15.157.190:46277/ using document root <none> and password file <none>
I20260929 06:38:13.202241 16528 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:13.202312 16528 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:13.202466 16528 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:13.203585 16528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "7f1300a582cf436faccc480b78779cdf"
format_stamp: "Formatted at 2026-09-29 06:38:13 on dist-test-slave-ltw5"
server_key: "2c212cb480ac00322230aaca62fca72a"
server_key_iv: "7a587e24d8d655b7443cd87a49e296bd"
server_key_version: "encryptionkey@0"
I20260929 06:38:13.203953 16528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "7f1300a582cf436faccc480b78779cdf"
format_stamp: "Formatted at 2026-09-29 06:38:13 on dist-test-slave-ltw5"
server_key: "2c212cb480ac00322230aaca62fca72a"
server_key_iv: "7a587e24d8d655b7443cd87a49e296bd"
server_key_version: "encryptionkey@0"
I20260929 06:38:13.205282 16528 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:38:13.206063 16543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:13.206251 16528 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:13.206349 16528 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "7f1300a582cf436faccc480b78779cdf"
format_stamp: "Formatted at 2026-09-29 06:38:13 on dist-test-slave-ltw5"
server_key: "2c212cb480ac00322230aaca62fca72a"
server_key_iv: "7a587e24d8d655b7443cd87a49e296bd"
server_key_version: "encryptionkey@0"
I20260929 06:38:13.206436 16528 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:13.226310 16528 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:13.228662 16528 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:13.228821 16528 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:13.232887 16528 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:45405
I20260929 06:38:13.232931 16595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:45405 every 8 connection(s)
I20260929 06:38:13.233301 16528 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:13.233590 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 16528
I20260929 06:38:13.233707 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:13.233901 15990 external_mini_cluster.cc:1428] Setting key 060b069eaa862a18081a80e048d68d00
I20260929 06:38:13.234326 16596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:13.237587 16596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf: Bootstrap starting.
I20260929 06:38:13.238269 16596 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:13.238577 16596 log.cc:824] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:13.239318 16596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf: No bootstrap required, opened a new log
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[16515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:13.241640 16596 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f1300a582cf436faccc480b78779cdf" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45405 } }
I20260929 06:38:13.241860 16596 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:13.241906 16596 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f1300a582cf436faccc480b78779cdf, State: Initialized, Role: FOLLOWER
I20260929 06:38:13.242096 16596 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f1300a582cf436faccc480b78779cdf" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45405 } }
I20260929 06:38:13.242198 16596 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:13.242245 16596 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:13.242296 16596 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:13.242941 16596 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f1300a582cf436faccc480b78779cdf" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45405 } }
I20260929 06:38:13.243065 16596 leader_election.cc:302] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f1300a582cf436faccc480b78779cdf; no voters:
I20260929 06:38:13.243243 16596 leader_election.cc:288] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:13.243281 16601 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:13.243450 16601 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [term 1 LEADER]: Becoming Leader. State: Replica: 7f1300a582cf436faccc480b78779cdf, State: Running, Role: LEADER
I20260929 06:38:13.243497 16596 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:13.243546 16601 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f1300a582cf436faccc480b78779cdf" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45405 } }
I20260929 06:38:13.243894 16602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f1300a582cf436faccc480b78779cdf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f1300a582cf436faccc480b78779cdf" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45405 } } }
I20260929 06:38:13.244028 16602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:13.243886 16601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f1300a582cf436faccc480b78779cdf. Latest consensus state: current_term: 1 leader_uuid: "7f1300a582cf436faccc480b78779cdf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f1300a582cf436faccc480b78779cdf" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45405 } } }
I20260929 06:38:13.244256 16601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:13.244397 16609 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:13.244882 16609 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:13.245713 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.234464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60356 (local address 127.15.157.190:45405)
0929 06:38:13.234655 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:13.234665 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:13.234697 (+ 32us) server_negotiation.cc:407] Connection header received
0929 06:38:13.235170 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:13.235178 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:13.235238 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:13.235390 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:13.235961 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.237322 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.238133 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.238767 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.238922 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.241520 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:13.241524 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:13.241524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:13.241533 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:13.243424 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.243916 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.243919 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.243920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.244044 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.244284 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.244285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.244285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.244585 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:13.245260 (+ 675us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:13.245385 (+ 125us) server_negotiation.cc:299] Negotiation successful
0929 06:38:13.245518 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":92,"threads_started":1}
I20260929 06:38:13.246462 16609 catalog_manager.cc:1347] Generated new cluster ID: 4411a4fa34d54e2fa37b479510038986
I20260929 06:38:13.246510 16609 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:13.262809 16609 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:13.263336 16609 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:13.268952 16609 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f1300a582cf436faccc480b78779cdf: Generated new TSK 0
I20260929 06:38:13.269143 16609 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:38:13.296900 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45405
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:36633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:13.376601 16622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:13.376796 16622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:13.376818 16622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:13.377950 16622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:13.378000 16622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:13.378084 16622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:13.379565 16622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:36633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45405
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:13.379804 16622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:13.380034 16622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:13.385275 16627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:13.385334 16630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:13.385275 16628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:13.385404 16622 server_base.cc:1034] running on GCE node
I20260929 06:38:13.385746 16622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:13.385982 16622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:13.387159 16622 hybrid_clock.cc:648] HybridClock initialized: now 1790663893387144 us; error 29 us; skew 500 ppm
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[16515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663893, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:13.389544 16622 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:38:13.390089 16622 webserver.cc:460] Webserver started at http://127.15.157.129:33139/ using document root <none> and password file <none>
I20260929 06:38:13.390329 16622 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:13.390396 16622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:13.390548 16622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:13.391705 16622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "f345616a63ac45f9abb2acc324e48d43"
format_stamp: "Formatted at 2026-09-29 06:38:13 on dist-test-slave-ltw5"
server_key: "c4d32543715deb4fe88dd5d9db88b4fc"
server_key_iv: "5ccc0f445de2c6318c04dac72bc7ec12"
server_key_version: "encryptionkey@0"
I20260929 06:38:13.392082 16622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "f345616a63ac45f9abb2acc324e48d43"
format_stamp: "Formatted at 2026-09-29 06:38:13 on dist-test-slave-ltw5"
server_key: "c4d32543715deb4fe88dd5d9db88b4fc"
server_key_iv: "5ccc0f445de2c6318c04dac72bc7ec12"
server_key_version: "encryptionkey@0"
I20260929 06:38:13.393440 16622 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:38:13.394186 16637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:13.394356 16622 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:13.394448 16622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "f345616a63ac45f9abb2acc324e48d43"
format_stamp: "Formatted at 2026-09-29 06:38:13 on dist-test-slave-ltw5"
server_key: "c4d32543715deb4fe88dd5d9db88b4fc"
server_key_iv: "5ccc0f445de2c6318c04dac72bc7ec12"
server_key_version: "encryptionkey@0"
I20260929 06:38:13.394531 16622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:13.403183 16622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:13.404959 16622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:13.405109 16622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:13.405318 16622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:13.405606 16622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:13.405658 16622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:13.405699 16622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:13.405727 16622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:13.411669 16622 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:45597
I20260929 06:38:13.411706 16750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:45597 every 8 connection(s)
I20260929 06:38:13.412042 16622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[16515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663893, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:13.421041 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.412733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:42035 (local address 127.15.157.190:45405)
0929 06:38:13.412783 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:13.412786 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:13.413025 (+ 239us) server_negotiation.cc:407] Connection header received
0929 06:38:13.413884 (+ 859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:13.413885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:13.413895 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:13.413960 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:13.414604 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.415095 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.416056 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.416252 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.416306 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.418380 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:13.418381 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:13.418382 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:13.418389 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:13.419695 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.420096 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.420098 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.420098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.420158 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.420409 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.420410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.420410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.420524 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:13.420592 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:13.420859 (+ 267us) server_negotiation.cc:299] Negotiation successful
0929 06:38:13.420946 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:38:13.421221 16753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.412734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45405 (local address 127.15.157.129:42035)
0929 06:38:13.412905 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:13.412939 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:13.413792 (+ 853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:13.414069 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:13.414073 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:13.414346 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:13.414528 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.414532 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.415168 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.415169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.415977 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.415978 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.416322 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.416322 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.416444 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.416887 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:13.416895 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:13.418283 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:13.419780 (+ 1497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:13.419787 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:13.419790 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:13.420019 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:13.420232 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:13.420233 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:13.420233 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:13.420337 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:13.420598 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:13.420604 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:13.420734 (+ 130us) client_negotiation.cc:769] Sending connection context
0929 06:38:13.420840 (+ 106us) client_negotiation.cc:240] Negotiation successful
0929 06:38:13.420997 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":90,"threads_started":1}
I20260929 06:38:13.421418 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 16622
I20260929 06:38:13.421525 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:38:13.421700 15990 external_mini_cluster.cc:1428] Setting key eef90f695b77c165c2a7fff3f1a29ed6
I20260929 06:38:13.421705 16751 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45405
I20260929 06:38:13.421849 16751 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:13.422063 16751 heartbeater.cc:511] Master 127.15.157.190:45405 requested a full tablet report, sending...
I20260929 06:38:13.422567 16560 ts_manager.cc:194] Registered new tserver with Master: f345616a63ac45f9abb2acc324e48d43 (127.15.157.129:45597)
I20260929 06:38:13.423158 16560 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:42035
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:38:13.446776 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45405
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:36633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:13.532852 16756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:13.533062 16756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:13.533087 16756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:13.534314 16756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:13.534356 16756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:13.534418 16756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:13.535910 16756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:36633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45405
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:13.536170 16756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:13.536409 16756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:13.541707 16764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:13.541697 16761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:13.541697 16762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:13.541879 16756 server_base.cc:1034] running on GCE node
I20260929 06:38:13.542150 16756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:13.542416 16756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:13.543639 16756 hybrid_clock.cc:648] HybridClock initialized: now 1790663893543615 us; error 37 us; skew 500 ppm
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[16515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663893, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:13.546312 16756 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:38:13.546715 16756 webserver.cc:460] Webserver started at http://127.15.157.130:37927/ using document root <none> and password file <none>
I20260929 06:38:13.546896 16756 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:13.546937 16756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:13.547029 16756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:13.548038 16756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "9da601bee4a5477b9a58cec9bbda6d6c"
format_stamp: "Formatted at 2026-09-29 06:38:13 on dist-test-slave-ltw5"
server_key: "afe0312872fad784b60e364626d474d1"
server_key_iv: "3ecf55932d8eb7db031ef302d130a9ce"
server_key_version: "encryptionkey@0"
I20260929 06:38:13.548336 16756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "9da601bee4a5477b9a58cec9bbda6d6c"
format_stamp: "Formatted at 2026-09-29 06:38:13 on dist-test-slave-ltw5"
server_key: "afe0312872fad784b60e364626d474d1"
server_key_iv: "3ecf55932d8eb7db031ef302d130a9ce"
server_key_version: "encryptionkey@0"
I20260929 06:38:13.549607 16756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260929 06:38:13.550319 16771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:13.550511 16756 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:13.550617 16756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "9da601bee4a5477b9a58cec9bbda6d6c"
format_stamp: "Formatted at 2026-09-29 06:38:13 on dist-test-slave-ltw5"
server_key: "afe0312872fad784b60e364626d474d1"
server_key_iv: "3ecf55932d8eb7db031ef302d130a9ce"
server_key_version: "encryptionkey@0"
I20260929 06:38:13.550690 16756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:13.568250 16756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:13.570726 16756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:13.570894 16756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:13.571138 16756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:13.571458 16756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:13.571492 16756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:13.571514 16756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:13.571560 16756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:13.577575 16756 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:40317
I20260929 06:38:13.577795 16884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:40317 every 8 connection(s)
I20260929 06:38:13.578049 16756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:38:13.581607 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 16756
I20260929 06:38:13.581725 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:38:13.581894 15990 external_mini_cluster.cc:1428] Setting key 85ca1b0258d0fdae9c241c6c0cfe5efb
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[16515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663893, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:13.588922 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.578849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:47533 (local address 127.15.157.190:45405)
0929 06:38:13.578894 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:13.578895 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:13.579121 (+ 226us) server_negotiation.cc:407] Connection header received
0929 06:38:13.580094 (+ 973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:13.580095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:13.580108 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:13.580172 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:13.580830 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.581323 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.582793 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.583011 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.583065 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.585539 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:13.585541 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:13.585541 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:13.585548 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:13.587424 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.587844 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.587845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.587846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.587916 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.588174 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.588175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.588176 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.588327 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:13.588403 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:13.588714 (+ 311us) server_negotiation.cc:299] Negotiation successful
0929 06:38:13.588797 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:38:13.589037 16887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.578821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45405 (local address 127.15.157.130:47533)
0929 06:38:13.578997 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:13.579033 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:13.579978 (+ 945us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:13.580250 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:13.580255 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:13.580526 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:13.580719 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.580723 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.581424 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.581425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.582698 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.582701 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.583094 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.583095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.583255 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.583801 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:13.583812 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:13.585438 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:13.587518 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:13.587524 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:13.587526 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:13.587766 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:13.588006 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:13.588007 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:13.588007 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:13.588106 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:13.588442 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:13.588448 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:13.588569 (+ 121us) client_negotiation.cc:769] Sending connection context
0929 06:38:13.588670 (+ 101us) client_negotiation.cc:240] Negotiation successful
0929 06:38:13.588794 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":88,"threads_started":1}
I20260929 06:38:13.589572 16885 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45405
I20260929 06:38:13.589685 16885 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:13.589884 16885 heartbeater.cc:511] Master 127.15.157.190:45405 requested a full tablet report, sending...
I20260929 06:38:13.590369 16560 ts_manager.cc:194] Registered new tserver with Master: 9da601bee4a5477b9a58cec9bbda6d6c (127.15.157.130:40317)
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
I20260929 06:38:13.590885 16560 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:47533
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:38:13.608726 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45405
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:36633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:13.687263 16890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:13.687454 16890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:13.687477 16890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:13.688531 16890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:13.688565 16890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:13.688591 16890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:13.689939 16890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:36633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45405
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:13.690176 16890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:13.690352 16890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:13.695137 16895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:13.695144 16898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:13.695144 16896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:13.695627 16890 server_base.cc:1034] running on GCE node
I20260929 06:38:13.695849 16890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:13.696164 16890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:13.697333 16890 hybrid_clock.cc:648] HybridClock initialized: now 1790663893697299 us; error 48 us; skew 500 ppm
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[16515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663893, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:13.699730 16890 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:38:13.700184 16890 webserver.cc:460] Webserver started at http://127.15.157.131:44849/ using document root <none> and password file <none>
I20260929 06:38:13.700359 16890 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:13.700397 16890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:13.700531 16890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:13.701524 16890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "cf337550d0b240ae80ffec323c826079"
format_stamp: "Formatted at 2026-09-29 06:38:13 on dist-test-slave-ltw5"
server_key: "49599e73fe20dafef034f0219fe928ca"
server_key_iv: "806bb74f1be30b1fe1f89da6786d1641"
server_key_version: "encryptionkey@0"
I20260929 06:38:13.701822 16890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "cf337550d0b240ae80ffec323c826079"
format_stamp: "Formatted at 2026-09-29 06:38:13 on dist-test-slave-ltw5"
server_key: "49599e73fe20dafef034f0219fe928ca"
server_key_iv: "806bb74f1be30b1fe1f89da6786d1641"
server_key_version: "encryptionkey@0"
I20260929 06:38:13.703145 16890 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:38:13.703867 16905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:13.704025 16890 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:13.704106 16890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "cf337550d0b240ae80ffec323c826079"
format_stamp: "Formatted at 2026-09-29 06:38:13 on dist-test-slave-ltw5"
server_key: "49599e73fe20dafef034f0219fe928ca"
server_key_iv: "806bb74f1be30b1fe1f89da6786d1641"
server_key_version: "encryptionkey@0"
I20260929 06:38:13.704159 16890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:13.734293 16890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:13.736374 16890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:13.736495 16890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:13.736686 16890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:13.736937 16890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:13.736967 16890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:13.736990 16890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:13.737002 16890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:13.742619 16890 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:35535
I20260929 06:38:13.742676 17018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:35535 every 8 connection(s)
I20260929 06:38:13.742995 16890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:38:13.743500 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 16890
I20260929 06:38:13.743606 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:38:13.743813 15990 external_mini_cluster.cc:1428] Setting key 6373b459d40af0d4da1eda0bb5c302e0
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[16515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663893, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:13.752633 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.743831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:54343 (local address 127.15.157.190:45405)
0929 06:38:13.743876 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:13.743878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:13.744260 (+ 382us) server_negotiation.cc:407] Connection header received
0929 06:38:13.745474 (+ 1214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:13.745475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:13.745486 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:13.745530 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:13.746206 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.746718 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.747724 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.747934 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.748016 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.750063 (+ 2047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:13.750065 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:13.750066 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:13.750075 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:13.751474 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.751842 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.751843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.751844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.751923 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.752149 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.752150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.752150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.752250 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:13.752315 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:13.752516 (+ 201us) server_negotiation.cc:299] Negotiation successful
0929 06:38:13.752571 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:13.752913 17021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.743840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45405 (local address 127.15.157.131:54343)
0929 06:38:13.744043 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:13.744137 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:13.745360 (+ 1223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:13.745598 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:13.745602 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:13.745851 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:13.746102 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.746107 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.746812 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.746813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.747623 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.747625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.748024 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.748025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.748159 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.748599 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:13.748606 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:13.749943 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:13.751548 (+ 1605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:13.751553 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:13.751555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:13.751767 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:13.751983 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:13.751984 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:13.751984 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:13.752092 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:13.752307 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:13.752310 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:13.752419 (+ 109us) client_negotiation.cc:769] Sending connection context
0929 06:38:13.752506 (+ 87us) client_negotiation.cc:240] Negotiation successful
0929 06:38:13.752617 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":78,"threads_started":1}
I20260929 06:38:13.753567 17019 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45405
I20260929 06:38:13.753646 17019 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:13.753834 17019 heartbeater.cc:511] Master 127.15.157.190:45405 requested a full tablet report, sending...
I20260929 06:38:13.754252 16560 ts_manager.cc:194] Registered new tserver with Master: cf337550d0b240ae80ffec323c826079 (127.15.157.131:35535)
I20260929 06:38:13.754668 16560 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:54343
I20260929 06:38:13.755605 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:38:13.762811 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.757082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60364 (local address 127.15.157.190:45405)
0929 06:38:13.757147 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:13.757149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:13.757268 (+ 119us) server_negotiation.cc:407] Connection header received
0929 06:38:13.757341 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:13.757342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:13.757351 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:13.757395 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:13.757973 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.758474 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.759211 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.759413 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.759495 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.760542 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:13.760543 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:13.760544 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:13.760550 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:13.761635 (+ 1085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.761983 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.761984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.761985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.762076 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.762290 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.762291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.762292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.762437 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:13.762536 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:13.762651 (+ 115us) server_negotiation.cc:299] Negotiation successful
0929 06:38:13.762719 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 06:38:13.764751 16560 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60364:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:38:13.766343 16560 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:13.772693 17030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.768518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40786 (local address 127.15.157.131:35535)
0929 06:38:13.768816 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:13.768821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:13.768871 (+ 50us) server_negotiation.cc:407] Connection header received
0929 06:38:13.768913 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:13.768915 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:13.768931 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:13.769016 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:13.769194 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.770050 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.771553 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.772258 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.772308 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.772371 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:13.772573 (+ 202us) server_negotiation.cc:299] Negotiation successful
0929 06:38:13.772616 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":76,"threads_started":1}
I20260929 06:38:13.772698 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.768486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47900 (local address 127.15.157.129:45597)
0929 06:38:13.768676 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:13.768680 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:13.768811 (+ 131us) server_negotiation.cc:407] Connection header received
0929 06:38:13.768961 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:13.768964 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:13.768980 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:13.769055 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:13.770089 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.770756 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.771808 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.772280 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.772381 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.772433 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:13.772571 (+ 138us) server_negotiation.cc:299] Negotiation successful
0929 06:38:13.772611 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":86,"threads_started":1}
I20260929 06:38:13.772927 17032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.768804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34290 (local address 127.15.157.130:40317)
0929 06:38:13.769168 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:13.769172 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:13.769182 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:38:13.769218 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:13.769221 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:13.769237 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:13.769314 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:13.769448 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.770291 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.771547 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.772258 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.772326 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.772371 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:13.772813 (+ 442us) server_negotiation.cc:299] Negotiation successful
0929 06:38:13.772866 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":80,"threads_started":1}
I20260929 06:38:13.772713 17028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.768601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:40317 (local address 127.0.0.1:34290)
0929 06:38:13.768748 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:13.768758 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:13.768798 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:13.769312 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:13.769313 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:13.769315 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:13.769355 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.769356 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.770414 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.770415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.771460 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.771462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.772407 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.772408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.772469 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.772487 (+ 18us) client_negotiation.cc:769] Sending connection context
0929 06:38:13.772561 (+ 74us) client_negotiation.cc:240] Negotiation successful
0929 06:38:13.772629 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":25,"thread_start_us":48,"threads_started":1}
I20260929 06:38:13.772712 17031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.768379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:45597 (local address 127.0.0.1:47900)
0929 06:38:13.768740 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:13.768751 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:13.768852 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:13.769060 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:13.769060 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:13.769061 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:13.769129 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.769130 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.770862 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.770863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.771727 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.771729 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.772380 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.772381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.772458 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.772477 (+ 19us) client_negotiation.cc:769] Sending connection context
0929 06:38:13.772556 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 06:38:13.772618 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"mutex_wait_us":25,"thread_start_us":52,"threads_started":1}
I20260929 06:38:13.773213 17027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.768379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:35535 (local address 127.0.0.1:40786)
0929 06:38:13.768550 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:13.768586 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:13.768647 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:13.769020 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:13.769041 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:13.769043 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:13.769126 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.769128 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.770139 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.770140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.771451 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.771453 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.772426 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.772426 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.772474 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.772480 (+ 6us) client_negotiation.cc:769] Sending connection context
0929 06:38:13.772786 (+ 306us) client_negotiation.cc:240] Negotiation successful
0929 06:38:13.772833 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":2,"thread_start_us":53,"threads_started":1}
I20260929 06:38:13.773778 16819 tablet_service.cc:1467] Processing CreateTablet for tablet a7b87fa0b47c43a4923a5fc5d0d35c0d (DEFAULT_TABLE table=test-table [id=0c600217b8bb409eaa7317e29df696e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:13.773940 16953 tablet_service.cc:1467] Processing CreateTablet for tablet a7b87fa0b47c43a4923a5fc5d0d35c0d (DEFAULT_TABLE table=test-table [id=0c600217b8bb409eaa7317e29df696e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:13.773940 16685 tablet_service.cc:1467] Processing CreateTablet for tablet a7b87fa0b47c43a4923a5fc5d0d35c0d (DEFAULT_TABLE table=test-table [id=0c600217b8bb409eaa7317e29df696e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:13.774187 16819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7b87fa0b47c43a4923a5fc5d0d35c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:13.774263 16953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7b87fa0b47c43a4923a5fc5d0d35c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:13.774263 16685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7b87fa0b47c43a4923a5fc5d0d35c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:13.776685 17033 tablet_bootstrap.cc:492] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c: Bootstrap starting.
I20260929 06:38:13.777269 17033 tablet_bootstrap.cc:654] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:13.777487 17035 tablet_bootstrap.cc:492] T a7b87fa0b47c43a4923a5fc5d0d35c0d P f345616a63ac45f9abb2acc324e48d43: Bootstrap starting.
I20260929 06:38:13.777875 17033 log.cc:824] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:13.778098 17034 tablet_bootstrap.cc:492] T a7b87fa0b47c43a4923a5fc5d0d35c0d P cf337550d0b240ae80ffec323c826079: Bootstrap starting.
I20260929 06:38:13.778167 17035 tablet_bootstrap.cc:654] T a7b87fa0b47c43a4923a5fc5d0d35c0d P f345616a63ac45f9abb2acc324e48d43: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:13.779017 17034 tablet_bootstrap.cc:654] T a7b87fa0b47c43a4923a5fc5d0d35c0d P cf337550d0b240ae80ffec323c826079: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:13.779110 17033 tablet_bootstrap.cc:492] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c: No bootstrap required, opened a new log
I20260929 06:38:13.779111 17035 log.cc:824] T a7b87fa0b47c43a4923a5fc5d0d35c0d P f345616a63ac45f9abb2acc324e48d43: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:13.779181 17033 ts_tablet_manager.cc:1397] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:38:13.779588 17034 log.cc:824] T a7b87fa0b47c43a4923a5fc5d0d35c0d P cf337550d0b240ae80ffec323c826079: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:13.780014 17035 tablet_bootstrap.cc:492] T a7b87fa0b47c43a4923a5fc5d0d35c0d P f345616a63ac45f9abb2acc324e48d43: No bootstrap required, opened a new log
I20260929 06:38:13.780083 17035 ts_tablet_manager.cc:1397] T a7b87fa0b47c43a4923a5fc5d0d35c0d P f345616a63ac45f9abb2acc324e48d43: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260929 06:38:13.780279 17034 tablet_bootstrap.cc:492] T a7b87fa0b47c43a4923a5fc5d0d35c0d P cf337550d0b240ae80ffec323c826079: No bootstrap required, opened a new log
I20260929 06:38:13.780359 17034 ts_tablet_manager.cc:1397] T a7b87fa0b47c43a4923a5fc5d0d35c0d P cf337550d0b240ae80ffec323c826079: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:38:13.781154 17033 raft_consensus.cc:348] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f345616a63ac45f9abb2acc324e48d43" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45597 } } peers { permanent_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40317 } } peers { permanent_uuid: "cf337550d0b240ae80ffec323c826079" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35535 } }
I20260929 06:38:13.781337 17033 raft_consensus.cc:374] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:13.781375 17033 raft_consensus.cc:729] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da601bee4a5477b9a58cec9bbda6d6c, State: Initialized, Role: FOLLOWER
I20260929 06:38:13.781512 17033 consensus_queue.cc:260] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f345616a63ac45f9abb2acc324e48d43" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45597 } } peers { permanent_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40317 } } peers { permanent_uuid: "cf337550d0b240ae80ffec323c826079" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35535 } }
I20260929 06:38:13.781785 17033 ts_tablet_manager.cc:1428] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:38:13.781924 16885 heartbeater.cc:503] Master 127.15.157.190:45405 was elected leader, sending a full tablet report...
I20260929 06:38:13.781962 17034 raft_consensus.cc:348] T a7b87fa0b47c43a4923a5fc5d0d35c0d P cf337550d0b240ae80ffec323c826079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f345616a63ac45f9abb2acc324e48d43" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45597 } } peers { permanent_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40317 } } peers { permanent_uuid: "cf337550d0b240ae80ffec323c826079" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35535 } }
I20260929 06:38:13.782140 17034 raft_consensus.cc:374] T a7b87fa0b47c43a4923a5fc5d0d35c0d P cf337550d0b240ae80ffec323c826079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:13.782182 17034 raft_consensus.cc:729] T a7b87fa0b47c43a4923a5fc5d0d35c0d P cf337550d0b240ae80ffec323c826079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf337550d0b240ae80ffec323c826079, State: Initialized, Role: FOLLOWER
I20260929 06:38:13.782291 17034 consensus_queue.cc:260] T a7b87fa0b47c43a4923a5fc5d0d35c0d P cf337550d0b240ae80ffec323c826079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f345616a63ac45f9abb2acc324e48d43" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45597 } } peers { permanent_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40317 } } peers { permanent_uuid: "cf337550d0b240ae80ffec323c826079" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35535 } }
I20260929 06:38:13.782249 17035 raft_consensus.cc:348] T a7b87fa0b47c43a4923a5fc5d0d35c0d P f345616a63ac45f9abb2acc324e48d43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f345616a63ac45f9abb2acc324e48d43" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45597 } } peers { permanent_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40317 } } peers { permanent_uuid: "cf337550d0b240ae80ffec323c826079" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35535 } }
I20260929 06:38:13.782403 17035 raft_consensus.cc:374] T a7b87fa0b47c43a4923a5fc5d0d35c0d P f345616a63ac45f9abb2acc324e48d43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:13.782435 17035 raft_consensus.cc:729] T a7b87fa0b47c43a4923a5fc5d0d35c0d P f345616a63ac45f9abb2acc324e48d43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f345616a63ac45f9abb2acc324e48d43, State: Initialized, Role: FOLLOWER
I20260929 06:38:13.782565 17019 heartbeater.cc:503] Master 127.15.157.190:45405 was elected leader, sending a full tablet report...
I20260929 06:38:13.782552 17035 consensus_queue.cc:260] T a7b87fa0b47c43a4923a5fc5d0d35c0d P f345616a63ac45f9abb2acc324e48d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f345616a63ac45f9abb2acc324e48d43" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45597 } } peers { permanent_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40317 } } peers { permanent_uuid: "cf337550d0b240ae80ffec323c826079" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35535 } }
I20260929 06:38:13.782792 17035 ts_tablet_manager.cc:1428] T a7b87fa0b47c43a4923a5fc5d0d35c0d P f345616a63ac45f9abb2acc324e48d43: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 06:38:13.782565 17034 ts_tablet_manager.cc:1428] T a7b87fa0b47c43a4923a5fc5d0d35c0d P cf337550d0b240ae80ffec323c826079: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:38:13.782904 16751 heartbeater.cc:503] Master 127.15.157.190:45405 was elected leader, sending a full tablet report...
I20260929 06:38:13.823841 17039 raft_consensus.cc:482] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:13.823995 17039 raft_consensus.cc:504] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f345616a63ac45f9abb2acc324e48d43" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45597 } } peers { permanent_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40317 } } peers { permanent_uuid: "cf337550d0b240ae80ffec323c826079" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35535 } }
I20260929 06:38:13.824404 17039 leader_election.cc:288] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f345616a63ac45f9abb2acc324e48d43 (127.15.157.129:45597), cf337550d0b240ae80ffec323c826079 (127.15.157.131:35535)
I20260929 06:38:13.827468 16887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.824618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:45597 (local address 127.15.157.130:32981)
0929 06:38:13.824663 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:13.824675 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:13.824723 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:13.824882 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:13.824883 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:13.824904 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:13.824975 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.824977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.825845 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.825846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.826659 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.826661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.827231 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.827232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.827310 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.827315 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:38:13.827369 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 06:38:13.827405 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260929 06:38:13.827519 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.824664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:32981 (local address 127.15.157.129:45597)
0929 06:38:13.824715 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:13.824717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:13.824729 (+ 12us) server_negotiation.cc:407] Connection header received
0929 06:38:13.824806 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:13.824808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:13.824818 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:13.824877 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:13.825062 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.825758 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.826745 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.827152 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.827206 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.827213 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:13.827383 (+ 170us) server_negotiation.cc:299] Negotiation successful
0929 06:38:13.827432 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 06:38:13.827641 17030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.824740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:50233 (local address 127.15.157.131:35535)
0929 06:38:13.824779 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:13.824781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:13.824915 (+ 134us) server_negotiation.cc:407] Connection header received
0929 06:38:13.824978 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:13.824979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:13.824989 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:13.825044 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:13.825191 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.825871 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.826871 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.827263 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.827345 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.827354 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:13.827521 (+ 167us) server_negotiation.cc:299] Negotiation successful
0929 06:38:13.827560 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 06:38:13.827790 17042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.824663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:35535 (local address 127.15.157.130:50233)
0929 06:38:13.824845 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:13.824854 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:13.824901 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:13.825062 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:13.825063 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:13.825064 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:13.825127 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.825128 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.825958 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.825958 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.826782 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:13.826784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.827360 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.827361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:13.827436 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.827441 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:38:13.827499 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 06:38:13.827738 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":110,"threads_started":1}
I20260929 06:38:13.827828 16705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7b87fa0b47c43a4923a5fc5d0d35c0d" candidate_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f345616a63ac45f9abb2acc324e48d43" is_pre_election: true
I20260929 06:38:13.828004 16705 raft_consensus.cc:2454] T a7b87fa0b47c43a4923a5fc5d0d35c0d P f345616a63ac45f9abb2acc324e48d43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da601bee4a5477b9a58cec9bbda6d6c in term 0.
I20260929 06:38:13.828188 16973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7b87fa0b47c43a4923a5fc5d0d35c0d" candidate_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf337550d0b240ae80ffec323c826079" is_pre_election: true
I20260929 06:38:13.828214 16772 leader_election.cc:302] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da601bee4a5477b9a58cec9bbda6d6c, f345616a63ac45f9abb2acc324e48d43; no voters:
I20260929 06:38:13.828312 16973 raft_consensus.cc:2454] T a7b87fa0b47c43a4923a5fc5d0d35c0d P cf337550d0b240ae80ffec323c826079 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da601bee4a5477b9a58cec9bbda6d6c in term 0.
I20260929 06:38:13.828375 17039 raft_consensus.cc:2781] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:13.828444 17039 raft_consensus.cc:482] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:13.828488 17039 raft_consensus.cc:3037] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [term 0 FOLLOWER]: Advancing to term 1
W20260929 06:38:13.828553 16886 tablet.cc:2369] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:38:13.829247 17039 raft_consensus.cc:504] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f345616a63ac45f9abb2acc324e48d43" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45597 } } peers { permanent_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40317 } } peers { permanent_uuid: "cf337550d0b240ae80ffec323c826079" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35535 } }
I20260929 06:38:13.829383 17039 leader_election.cc:288] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [CANDIDATE]: Term 1 election: Requested vote from peers f345616a63ac45f9abb2acc324e48d43 (127.15.157.129:45597), cf337550d0b240ae80ffec323c826079 (127.15.157.131:35535)
I20260929 06:38:13.829555 16973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7b87fa0b47c43a4923a5fc5d0d35c0d" candidate_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf337550d0b240ae80ffec323c826079"
I20260929 06:38:13.829532 16705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7b87fa0b47c43a4923a5fc5d0d35c0d" candidate_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f345616a63ac45f9abb2acc324e48d43"
I20260929 06:38:13.829627 16973 raft_consensus.cc:3037] T a7b87fa0b47c43a4923a5fc5d0d35c0d P cf337550d0b240ae80ffec323c826079 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:13.829627 16705 raft_consensus.cc:3037] T a7b87fa0b47c43a4923a5fc5d0d35c0d P f345616a63ac45f9abb2acc324e48d43 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:13.830567 16973 raft_consensus.cc:2454] T a7b87fa0b47c43a4923a5fc5d0d35c0d P cf337550d0b240ae80ffec323c826079 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da601bee4a5477b9a58cec9bbda6d6c in term 1.
I20260929 06:38:13.830567 16705 raft_consensus.cc:2454] T a7b87fa0b47c43a4923a5fc5d0d35c0d P f345616a63ac45f9abb2acc324e48d43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da601bee4a5477b9a58cec9bbda6d6c in term 1.
I20260929 06:38:13.830734 16772 leader_election.cc:302] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da601bee4a5477b9a58cec9bbda6d6c, f345616a63ac45f9abb2acc324e48d43; no voters:
I20260929 06:38:13.830870 17039 raft_consensus.cc:2781] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:13.831023 17039 raft_consensus.cc:686] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [term 1 LEADER]: Becoming Leader. State: Replica: 9da601bee4a5477b9a58cec9bbda6d6c, State: Running, Role: LEADER
I20260929 06:38:13.831118 17039 consensus_queue.cc:237] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f345616a63ac45f9abb2acc324e48d43" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45597 } } peers { permanent_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40317 } } peers { permanent_uuid: "cf337550d0b240ae80ffec323c826079" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35535 } }
I20260929 06:38:13.831833 16559 catalog_manager.cc:5495] T a7b87fa0b47c43a4923a5fc5d0d35c0d P 9da601bee4a5477b9a58cec9bbda6d6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da601bee4a5477b9a58cec9bbda6d6c (127.15.157.130). New cstate: current_term: 1 leader_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f345616a63ac45f9abb2acc324e48d43" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da601bee4a5477b9a58cec9bbda6d6c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf337550d0b240ae80ffec323c826079" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35535 } health_report { overall_health: UNKNOWN } } }
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[16515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.129@KRBTEST.COM
I20260929 06:38:13.849141 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.841592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47910 (local address 127.15.157.129:45597)
0929 06:38:13.841671 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:13.841678 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:13.841743 (+ 65us) server_negotiation.cc:407] Connection header received
0929 06:38:13.841785 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:13.841785 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:13.841794 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:13.841922 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:13.842514 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.843164 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.843902 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.844079 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.844135 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.846652 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:13.846663 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:13.846663 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:13.846671 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:13.848116 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.848456 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.848460 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.848460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.848521 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.848708 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.848709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.848709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.848843 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:13.848953 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:13.849010 (+ 57us) server_negotiation.cc:299] Negotiation successful
0929 06:38:13.849074 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[16515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663893, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[16515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663893, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.157.129@KRBTEST.COM
I20260929 06:38:13.872519 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.865366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47914 (local address 127.15.157.129:45597)
0929 06:38:13.865454 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:13.865465 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:13.865530 (+ 65us) server_negotiation.cc:407] Connection header received
0929 06:38:13.865574 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:13.865575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:13.865584 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:13.865647 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:13.866303 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.866794 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.867509 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.867701 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.867757 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.870116 (+ 2359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:13.870117 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:13.870117 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:13.870123 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:13.871457 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.871774 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.871775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.871775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.871829 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.872027 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.872028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.872028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.872147 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:13.872231 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:13.872384 (+ 153us) server_negotiation.cc:299] Negotiation successful
0929 06:38:13.872449 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[16515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[16515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.129@KRBTEST.COM
I20260929 06:38:13.895295 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:13.887834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47918 (local address 127.15.157.129:45597)
0929 06:38:13.887897 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:13.887898 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:13.887968 (+ 70us) server_negotiation.cc:407] Connection header received
0929 06:38:13.888017 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:13.888017 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:13.888025 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:13.888081 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:13.888609 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.889058 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.889789 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:13.889973 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:13.890118 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:13.892379 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:13.892380 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:13.892380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:13.892387 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:13.894195 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.894667 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.894668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.894668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.894756 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:13.894933 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:13.894933 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:13.894933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:13.895019 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:13.895092 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:13.895174 (+ 82us) server_negotiation.cc:299] Negotiation successful
0929 06:38:13.895229 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260929 06:38:13.895776 16665 tablet_service.cc:2908] Rejecting scan request for tablet a7b87fa0b47c43a4923a5fc5d0d35c0d: Uninitialized: clean time has not yet been initialized
I20260929 06:38:13.896710 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 16622
I20260929 06:38:13.901296 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 16756
I20260929 06:38:13.905841 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 16890
I20260929 06:38:13.910290 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 16528
2026-09-29T06:38:13Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (1978 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[17057](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[17057](info): set up 2 sockets
Sep 29 06:38:13 dist-test-slave-ltw5 krb5kdc[17057](info): commencing operation
krb5kdc: starting...
W20260929 06:38:14.950011 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:38:15 dist-test-slave-ltw5 krb5kdc[17057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663895, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:38:15.069211 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45757
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:45757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:15.151508 17070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:15.151767 17070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:15.151804 17070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:15.152971 17070 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:15.153046 17070 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260929 06:38:15.153066 17070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:15.153087 17070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:15.153115 17070 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:15.153144 17070 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:15.154645 17070 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:45757
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:15.154947 17070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:15.155180 17070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:15.159931 17078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:15.159958 17075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:15.159932 17076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:15.160156 17070 server_base.cc:1034] running on GCE node
I20260929 06:38:15.160391 17070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:15.160669 17070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:15.161849 17070 hybrid_clock.cc:648] HybridClock initialized: now 1790663895161841 us; error 42 us; skew 500 ppm
Sep 29 06:38:15 dist-test-slave-ltw5 krb5kdc[17057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663895, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:15.170987 17070 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:38:15.171427 17070 webserver.cc:460] Webserver started at http://127.15.157.190:36881/ using document root <none> and password file <none>
I20260929 06:38:15.171666 17070 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:15.171712 17070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:15.171857 17070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:15.172912 17070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "887f93e4215c46cb84e1db84aaa27e09"
format_stamp: "Formatted at 2026-09-29 06:38:15 on dist-test-slave-ltw5"
server_key: "11fb89f5ec7f4b31627ae641352800db"
server_key_iv: "452ad22228774fca797797fd2abeead8"
server_key_version: "encryptionkey@0"
I20260929 06:38:15.173275 17070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "887f93e4215c46cb84e1db84aaa27e09"
format_stamp: "Formatted at 2026-09-29 06:38:15 on dist-test-slave-ltw5"
server_key: "11fb89f5ec7f4b31627ae641352800db"
server_key_iv: "452ad22228774fca797797fd2abeead8"
server_key_version: "encryptionkey@0"
I20260929 06:38:15.174733 17070 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:38:15.175516 17085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:15.175704 17070 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:15.175815 17070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "887f93e4215c46cb84e1db84aaa27e09"
format_stamp: "Formatted at 2026-09-29 06:38:15 on dist-test-slave-ltw5"
server_key: "11fb89f5ec7f4b31627ae641352800db"
server_key_iv: "452ad22228774fca797797fd2abeead8"
server_key_version: "encryptionkey@0"
I20260929 06:38:15.175896 17070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:15.193620 17070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:15.196123 17070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:15.196285 17070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:15.201005 17070 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:45757
I20260929 06:38:15.201089 17147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:45757 every 8 connection(s)
I20260929 06:38:15.201398 17070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:15.202009 17148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:15.204156 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 17070
I20260929 06:38:15.204253 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:15.204411 15990 external_mini_cluster.cc:1428] Setting key 3bd1a3dfc655611b4850cc6b1f022af1
I20260929 06:38:15.204569 17148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09: Bootstrap starting.
I20260929 06:38:15.205242 17148 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:15.205535 17148 log.cc:824] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:15.206252 17148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09: No bootstrap required, opened a new log
I20260929 06:38:15.208016 17148 raft_consensus.cc:348] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "887f93e4215c46cb84e1db84aaa27e09" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45757 } }
I20260929 06:38:15.208176 17148 raft_consensus.cc:374] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:15.208222 17148 raft_consensus.cc:729] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 887f93e4215c46cb84e1db84aaa27e09, State: Initialized, Role: FOLLOWER
I20260929 06:38:15.208393 17148 consensus_queue.cc:260] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "887f93e4215c46cb84e1db84aaa27e09" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45757 } }
I20260929 06:38:15.208487 17148 raft_consensus.cc:388] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:15.208529 17148 raft_consensus.cc:482] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:15.208577 17148 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:15.209074 17148 raft_consensus.cc:504] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "887f93e4215c46cb84e1db84aaa27e09" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45757 } }
I20260929 06:38:15.209192 17148 leader_election.cc:302] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 887f93e4215c46cb84e1db84aaa27e09; no voters:
I20260929 06:38:15.209374 17148 leader_election.cc:288] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:15.209436 17153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:15.209583 17153 raft_consensus.cc:686] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [term 1 LEADER]: Becoming Leader. State: Replica: 887f93e4215c46cb84e1db84aaa27e09, State: Running, Role: LEADER
I20260929 06:38:15.209630 17148 sys_catalog.cc:564] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:15.209671 17153 consensus_queue.cc:237] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "887f93e4215c46cb84e1db84aaa27e09" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45757 } }
I20260929 06:38:15.210047 17154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "887f93e4215c46cb84e1db84aaa27e09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "887f93e4215c46cb84e1db84aaa27e09" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45757 } } }
I20260929 06:38:15.210055 17153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 887f93e4215c46cb84e1db84aaa27e09. Latest consensus state: current_term: 1 leader_uuid: "887f93e4215c46cb84e1db84aaa27e09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "887f93e4215c46cb84e1db84aaa27e09" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45757 } } }
I20260929 06:38:15.210155 17154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:15.210167 17153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:15.210361 17161 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:15.210847 17161 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 29 06:38:15 dist-test-slave-ltw5 krb5kdc[17057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663895, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:15.212726 17161 catalog_manager.cc:1347] Generated new cluster ID: 4e382e61d66d400ab41afb443db7ce9d
I20260929 06:38:15.212781 17161 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:15.215667 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.205013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43626 (local address 127.15.157.190:45757)
0929 06:38:15.205196 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:15.205205 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:15.205238 (+ 33us) server_negotiation.cc:407] Connection header received
0929 06:38:15.205762 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:15.205769 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:15.205861 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:15.206005 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:15.206721 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.207592 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.208401 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.208913 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.209024 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.212076 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:15.212080 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:15.212080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:15.212091 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:15.214087 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.214501 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.214504 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.214504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.214601 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.214801 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.214802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.214802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.215071 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:15.215218 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:15.215339 (+ 121us) server_negotiation.cc:299] Negotiation successful
0929 06:38:15.215462 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":73,"threads_started":1}
I20260929 06:38:15.229772 17161 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:15.230414 17161 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:15.233270 17161 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09: Generated new TSK 0
I20260929 06:38:15.233492 17161 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:38:15.260921 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45757
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:15.341128 17174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:15.341337 17174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:15.341361 17174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:15.342571 17174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:15.342617 17174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:15.342638 17174 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:38:15.342655 17174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:15.344110 17174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.157.190:45757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:15.344357 17174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:15.344602 17174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:15.349525 17182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:15.349514 17179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:15.349514 17180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:15.349848 17174 server_base.cc:1034] running on GCE node
I20260929 06:38:15.350091 17174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:15.350322 17174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:15.351462 17174 hybrid_clock.cc:648] HybridClock initialized: now 1790663895351444 us; error 41 us; skew 500 ppm
Sep 29 06:38:15 dist-test-slave-ltw5 krb5kdc[17057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663895, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:15.353947 17174 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:38:15.354496 17174 webserver.cc:460] Webserver started at http://127.15.157.129:44207/ using document root <none> and password file <none>
I20260929 06:38:15.354722 17174 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:15.354765 17174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:15.354931 17174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:15.355986 17174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "812247faeab54380a2e739a3b6fbc0ee"
format_stamp: "Formatted at 2026-09-29 06:38:15 on dist-test-slave-ltw5"
server_key: "07d049300dd001c20a99048fa39a0f21"
server_key_iv: "8081d0980a02bfe92905593f19d1be03"
server_key_version: "encryptionkey@0"
I20260929 06:38:15.356343 17174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "812247faeab54380a2e739a3b6fbc0ee"
format_stamp: "Formatted at 2026-09-29 06:38:15 on dist-test-slave-ltw5"
server_key: "07d049300dd001c20a99048fa39a0f21"
server_key_iv: "8081d0980a02bfe92905593f19d1be03"
server_key_version: "encryptionkey@0"
I20260929 06:38:15.357702 17174 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:38:15.358428 17189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:15.358608 17174 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:15.358676 17174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "812247faeab54380a2e739a3b6fbc0ee"
format_stamp: "Formatted at 2026-09-29 06:38:15 on dist-test-slave-ltw5"
server_key: "07d049300dd001c20a99048fa39a0f21"
server_key_iv: "8081d0980a02bfe92905593f19d1be03"
server_key_version: "encryptionkey@0"
I20260929 06:38:15.358765 17174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:15.378969 17174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:15.381012 17174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:15.381156 17174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:15.381678 17174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:15.381716 17174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:15.381738 17174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:15.381791 17174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:15.389006 17174 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:42161
I20260929 06:38:15.389075 17304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:42161 every 8 connection(s)
Sep 29 06:38:15 dist-test-slave-ltw5 krb5kdc[17057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663895, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:15.389389 17174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:38:15.392485 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.382267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:46285 (local address 127.15.157.190:45757)
0929 06:38:15.382341 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:15.382343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:15.382578 (+ 235us) server_negotiation.cc:407] Connection header received
0929 06:38:15.383056 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:15.383058 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:15.383073 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:15.383166 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:15.384034 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.384885 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.386233 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.386616 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.386697 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.389702 (+ 3005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:15.389703 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:15.389703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:15.389711 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:15.391226 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.391708 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.391709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.391709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.391766 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.391996 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.391997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.391997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.392099 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:15.392151 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:15.392355 (+ 204us) server_negotiation.cc:299] Negotiation successful
0929 06:38:15.392418 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260929 06:38:15.392642 17198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.382249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45757 (local address 127.15.157.129:46285)
0929 06:38:15.382432 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:15.382471 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:15.382950 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:15.383218 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:15.383221 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:15.383633 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:15.383915 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.383921 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.384992 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.384993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.386157 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.386160 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.386727 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.386728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.386853 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.387950 (+ 1097us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:15.387959 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:15.389592 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:15.391305 (+ 1713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:15.391310 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:15.391311 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:15.391542 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:15.391837 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:15.391838 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:15.391838 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:15.391939 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:15.392155 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:15.392158 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:15.392266 (+ 108us) client_negotiation.cc:769] Sending connection context
0929 06:38:15.392344 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 06:38:15.392458 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":120,"threads_started":1}
I20260929 06:38:15.393110 17305 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45757
I20260929 06:38:15.393196 17305 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:15.393388 17305 heartbeater.cc:511] Master 127.15.157.190:45757 requested a full tablet report, sending...
I20260929 06:38:15.393944 17101 ts_manager.cc:194] Registered new tserver with Master: 812247faeab54380a2e739a3b6fbc0ee (127.15.157.129:42161)
I20260929 06:38:15.394908 17101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:46285
I20260929 06:38:15.395987 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 17174
I20260929 06:38:15.396096 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:38:15.396281 15990 external_mini_cluster.cc:1428] Setting key 2dfa631a27fa2be820b32ea589b0250b
I20260929 06:38:15.400092 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.394278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:49761 (local address 127.15.157.190:45757)
0929 06:38:15.394317 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:15.394319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:15.394447 (+ 128us) server_negotiation.cc:407] Connection header received
0929 06:38:15.394500 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:15.394501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:15.394509 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:15.394550 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:15.394865 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.395425 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.396519 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.396696 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.396747 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.397656 (+ 909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:15.397657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:15.397658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:15.397666 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:15.399078 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.399460 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.399461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.399461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.399506 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.399697 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.399697 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.399698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.399783 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:15.399831 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:15.399982 (+ 151us) server_negotiation.cc:299] Negotiation successful
0929 06:38:15.400036 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:38:15.400223 17311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.394197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45757 (local address 127.15.157.129:49761)
0929 06:38:15.394375 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:15.394385 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:15.394445 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:15.394562 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:15.394562 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:15.394745 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:15.394803 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.394805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.395516 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.395517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.396349 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.396352 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.396760 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.396761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.396836 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.397294 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:15.397299 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:15.397571 (+ 272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:15.399159 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:15.399160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:15.399160 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:15.399386 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:15.399568 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:15.399569 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:15.399569 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:15.399639 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:15.399841 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:15.399842 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:15.399890 (+ 48us) client_negotiation.cc:769] Sending connection context
0929 06:38:15.399965 (+ 75us) client_negotiation.cc:240] Negotiation successful
0929 06:38:15.400073 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":1,"thread_start_us":85,"threads_started":1}
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:38:15.421592 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45757
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:15.502482 17314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:15.502712 17314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:15.502750 17314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:15.503895 17314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:15.503960 17314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:15.503998 17314 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:38:15.504056 17314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:15.505462 17314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.157.190:45757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:15.505729 17314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:15.505957 17314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:15.510982 17320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:15.510991 17319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:15.511195 17314 server_base.cc:1034] running on GCE node
W20260929 06:38:15.511068 17322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:15.511510 17314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:15.511776 17314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:15.512914 17314 hybrid_clock.cc:648] HybridClock initialized: now 1790663895512902 us; error 29 us; skew 500 ppm
Sep 29 06:38:15 dist-test-slave-ltw5 krb5kdc[17057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663895, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:15.515313 17314 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:38:15.515807 17314 webserver.cc:460] Webserver started at http://127.15.157.130:43933/ using document root <none> and password file <none>
I20260929 06:38:15.516039 17314 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:15.516106 17314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:15.516254 17314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:15.517239 17314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "7a64f210c8564f299d7d8a8ae25c7c7d"
format_stamp: "Formatted at 2026-09-29 06:38:15 on dist-test-slave-ltw5"
server_key: "16ed7f44ff73682790cee3a83392fbdc"
server_key_iv: "0bdbdd30fa01b54ff743d72c8f0d200a"
server_key_version: "encryptionkey@0"
I20260929 06:38:15.517585 17314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "7a64f210c8564f299d7d8a8ae25c7c7d"
format_stamp: "Formatted at 2026-09-29 06:38:15 on dist-test-slave-ltw5"
server_key: "16ed7f44ff73682790cee3a83392fbdc"
server_key_iv: "0bdbdd30fa01b54ff743d72c8f0d200a"
server_key_version: "encryptionkey@0"
I20260929 06:38:15.518965 17314 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:38:15.519706 17329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:15.519898 17314 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:15.519994 17314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "7a64f210c8564f299d7d8a8ae25c7c7d"
format_stamp: "Formatted at 2026-09-29 06:38:15 on dist-test-slave-ltw5"
server_key: "16ed7f44ff73682790cee3a83392fbdc"
server_key_iv: "0bdbdd30fa01b54ff743d72c8f0d200a"
server_key_version: "encryptionkey@0"
I20260929 06:38:15.520067 17314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:15.538488 17314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:15.540786 17314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:15.540967 17314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:15.541535 17314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:15.541603 17314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:15.541654 17314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:15.541682 17314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 06:38:15 dist-test-slave-ltw5 krb5kdc[17057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663895, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:15.549079 17314 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:39479
I20260929 06:38:15.549144 17444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:39479 every 8 connection(s)
I20260929 06:38:15.549528 17314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:38:15.552115 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.542073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:35571 (local address 127.15.157.190:45757)
0929 06:38:15.542116 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:15.542118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:15.542386 (+ 268us) server_negotiation.cc:407] Connection header received
0929 06:38:15.542908 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:15.542910 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:15.542922 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:15.542967 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:15.543724 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.544676 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.546306 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.546626 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.546703 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.549521 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:15.549522 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:15.549523 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:15.549531 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:15.550988 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.551365 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.551366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.551367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.551418 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.551626 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.551627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.551627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.551725 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:15.551773 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:15.551996 (+ 223us) server_negotiation.cc:299] Negotiation successful
0929 06:38:15.552054 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:15.552348 17338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.542108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45757 (local address 127.15.157.130:35571)
0929 06:38:15.542260 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:15.542295 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:15.542794 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:15.543039 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:15.543042 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:15.543328 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:15.543595 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.543616 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.544815 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.544817 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.546200 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.546202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.546735 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.546737 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.546930 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.547454 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:15.547468 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:15.549428 (+ 1960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:15.551075 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:15.551081 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:15.551083 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:15.551294 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:15.551480 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:15.551481 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:15.551481 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:15.551573 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:15.551777 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:15.551781 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:15.551892 (+ 111us) client_negotiation.cc:769] Sending connection context
0929 06:38:15.551971 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 06:38:15.552088 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":94,"threads_started":1}
I20260929 06:38:15.552879 17445 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45757
I20260929 06:38:15.552958 17445 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:15.553143 17445 heartbeater.cc:511] Master 127.15.157.190:45757 requested a full tablet report, sending...
I20260929 06:38:15.553557 17101 ts_manager.cc:194] Registered new tserver with Master: 7a64f210c8564f299d7d8a8ae25c7c7d (127.15.157.130:39479)
I20260929 06:38:15.553967 17101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:35571
I20260929 06:38:15.556407 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 17314
I20260929 06:38:15.556510 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:38:15.556684 15990 external_mini_cluster.cc:1428] Setting key 3cc7556ed559420dbae4c98219b8d1f6
I20260929 06:38:15.559870 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.554066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:43105 (local address 127.15.157.190:45757)
0929 06:38:15.554104 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:15.554105 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:15.554280 (+ 175us) server_negotiation.cc:407] Connection header received
0929 06:38:15.554311 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:15.554312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:15.554322 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:15.554385 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:15.554717 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.555206 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.556048 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.556244 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.556310 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.557335 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:15.557336 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:15.557337 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:15.557344 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:15.558713 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.559066 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.559067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.559067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.559124 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.559334 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.559335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.559335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.559478 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:15.559551 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:15.559705 (+ 154us) server_negotiation.cc:299] Negotiation successful
0929 06:38:15.559775 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:38:15.559870 17451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.553964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45757 (local address 127.15.157.130:43105)
0929 06:38:15.554190 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:15.554199 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:15.554242 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:15.554401 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:15.554402 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:15.554591 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:15.554645 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.554646 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.555289 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.555290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.555765 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.555766 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.556348 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.556349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.556428 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.556877 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:15.556882 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:15.557255 (+ 373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:15.558814 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:15.558815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:15.558815 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:15.558984 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:15.559189 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:15.559190 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:15.559190 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:15.559246 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:15.559553 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:15.559554 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:15.559597 (+ 43us) client_negotiation.cc:769] Sending connection context
0929 06:38:15.559679 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 06:38:15.559776 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":131,"threads_started":1}
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:38:15.581595 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45757
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:15.660441 17454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:15.660632 17454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:15.660655 17454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:15.661791 17454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:15.661841 17454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:15.661861 17454 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:38:15.661881 17454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:15.663264 17454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.157.190:45757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:15.663450 17454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:15.663621 17454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:15.668404 17459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:15.668419 17460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:15.668467 17462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:15.668725 17454 server_base.cc:1034] running on GCE node
I20260929 06:38:15.668919 17454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:15.669114 17454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:15.670230 17454 hybrid_clock.cc:648] HybridClock initialized: now 1790663895670219 us; error 30 us; skew 500 ppm
Sep 29 06:38:15 dist-test-slave-ltw5 krb5kdc[17057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663895, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:15.672567 17454 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:38:15.673084 17454 webserver.cc:460] Webserver started at http://127.15.157.131:38179/ using document root <none> and password file <none>
I20260929 06:38:15.673314 17454 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:15.673388 17454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:15.673533 17454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:15.674582 17454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "5bc7006989f840db94051f90540ea803"
format_stamp: "Formatted at 2026-09-29 06:38:15 on dist-test-slave-ltw5"
server_key: "0a73e19fe81cfa2fc23a015ab278d9a4"
server_key_iv: "4ae38fef1fcd55612da329110e5907eb"
server_key_version: "encryptionkey@0"
I20260929 06:38:15.674923 17454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "5bc7006989f840db94051f90540ea803"
format_stamp: "Formatted at 2026-09-29 06:38:15 on dist-test-slave-ltw5"
server_key: "0a73e19fe81cfa2fc23a015ab278d9a4"
server_key_iv: "4ae38fef1fcd55612da329110e5907eb"
server_key_version: "encryptionkey@0"
I20260929 06:38:15.676262 17454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:15.676971 17469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:15.677136 17454 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:15.677230 17454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "5bc7006989f840db94051f90540ea803"
format_stamp: "Formatted at 2026-09-29 06:38:15 on dist-test-slave-ltw5"
server_key: "0a73e19fe81cfa2fc23a015ab278d9a4"
server_key_iv: "4ae38fef1fcd55612da329110e5907eb"
server_key_version: "encryptionkey@0"
I20260929 06:38:15.677304 17454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:15.690428 17454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:15.692346 17454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:15.692507 17454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:15.693014 17454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:15.693073 17454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:15.693109 17454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:15.693133 17454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 06:38:15 dist-test-slave-ltw5 krb5kdc[17057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663895, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:15.700350 17454 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:38715
I20260929 06:38:15.700443 17584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:38715 every 8 connection(s)
I20260929 06:38:15.700816 17454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:38:15.702437 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.693437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:55793 (local address 127.15.157.190:45757)
0929 06:38:15.693499 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:15.693502 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:15.693746 (+ 244us) server_negotiation.cc:407] Connection header received
0929 06:38:15.694316 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:15.694317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:15.694330 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:15.694411 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:15.694966 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.695468 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.696533 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.696866 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.696957 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.699512 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:15.699515 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:15.699515 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:15.699533 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:15.701241 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.701612 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.701612 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.701613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.701666 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.701871 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.701872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.701872 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.701991 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:15.702102 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:15.702312 (+ 210us) server_negotiation.cc:299] Negotiation successful
0929 06:38:15.702374 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 06:38:15.702601 17478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.693449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45757 (local address 127.15.157.131:55793)
0929 06:38:15.693619 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:15.693657 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:15.694204 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:15.694464 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:15.694467 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:15.694691 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:15.694866 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.694870 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.695559 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.695560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.696432 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.696435 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.696967 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.696967 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.697109 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.697583 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:15.697591 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:15.699408 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:15.701338 (+ 1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:15.701341 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:15.701342 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:15.701547 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:15.701725 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:15.701725 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:15.701726 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:15.701818 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:15.702096 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:15.702100 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:15.702204 (+ 104us) client_negotiation.cc:769] Sending connection context
0929 06:38:15.702285 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 06:38:15.702409 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":93,"threads_started":1}
I20260929 06:38:15.703086 17585 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45757
I20260929 06:38:15.703166 17585 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:15.703343 17585 heartbeater.cc:511] Master 127.15.157.190:45757 requested a full tablet report, sending...
I20260929 06:38:15.703749 17101 ts_manager.cc:194] Registered new tserver with Master: 5bc7006989f840db94051f90540ea803 (127.15.157.131:38715)
I20260929 06:38:15.704257 17101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:55793
I20260929 06:38:15.705960 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 17454
I20260929 06:38:15.706080 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:38:15.706246 15990 external_mini_cluster.cc:1428] Setting key 2059cbb5c236d005e8102b709852f38e
I20260929 06:38:15.707110 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:38:15.709841 17591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.704157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45757 (local address 127.15.157.131:34663)
0929 06:38:15.704421 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:15.704433 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:15.704495 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:15.704584 (+ 89us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:15.704585 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:15.704747 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:15.704790 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.704792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.705390 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.705391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.705936 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.705938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.706387 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.706388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.706487 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.706903 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:15.706907 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:15.707254 (+ 347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:15.708973 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:15.708974 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:15.708974 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:15.709122 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:15.709348 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:15.709349 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:15.709349 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:15.709404 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:15.709638 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:15.709639 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:15.709669 (+ 30us) client_negotiation.cc:769] Sending connection context
0929 06:38:15.709716 (+ 47us) client_negotiation.cc:240] Negotiation successful
0929 06:38:15.709783 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":64,"threads_started":1}
I20260929 06:38:15.709981 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.704225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:34663 (local address 127.15.157.190:45757)
0929 06:38:15.704260 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:15.704261 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:15.704501 (+ 240us) server_negotiation.cc:407] Connection header received
0929 06:38:15.704531 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:15.704532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:15.704540 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:15.704580 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:15.704850 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.705288 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.706056 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.706285 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.706373 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.707350 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:15.707352 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:15.707352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:15.707359 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:15.708890 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.709218 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.709219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.709219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.709281 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.709450 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.709450 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.709451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.709580 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:15.709648 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:15.709766 (+ 118us) server_negotiation.cc:299] Negotiation successful
0929 06:38:15.709847 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Sep 29 06:38:15 dist-test-slave-ltw5 krb5kdc[17057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663895, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 06:38:15 dist-test-slave-ltw5 krb5kdc[17057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663895, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:15.729259 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.722886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43642 (local address 127.15.157.190:45757)
0929 06:38:15.722948 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:15.722950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:15.722958 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:15.722979 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:15.722979 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:15.722988 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:15.723042 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:15.723536 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.724075 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.724757 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.724957 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.725018 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.727133 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:15.727134 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:15.727134 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:15.727140 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:15.728261 (+ 1121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.728602 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.728603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.728603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.728649 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:15.728803 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:15.728804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:15.728804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:15.728909 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:15.728983 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:15.729143 (+ 160us) server_negotiation.cc:299] Negotiation successful
0929 06:38:15.729197 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:38:15.731040 17101 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43642:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:38:15.732553 17101 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:15.739264 17600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.734835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:39479 (local address 127.0.0.1:34280)
0929 06:38:15.735018 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:15.735057 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:15.735122 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:15.735851 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:15.735852 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:15.735854 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:15.735904 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.735906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.736772 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.736773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.737949 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.737951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.738956 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.738957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.739051 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.739067 (+ 16us) client_negotiation.cc:769] Sending connection context
0929 06:38:15.739139 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 06:38:15.739190 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":79,"threads_started":1}
I20260929 06:38:15.739344 17604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.735531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34280 (local address 127.15.157.130:39479)
0929 06:38:15.735696 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:15.735700 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:15.735708 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:15.735738 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:15.735739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:15.735752 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:15.735855 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:15.735986 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.736686 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.738099 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.738853 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.738949 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.739013 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:15.739171 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 06:38:15.739218 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":87,"threads_started":1}
I20260929 06:38:15.739696 17601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.734866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:38715 (local address 127.0.0.1:45774)
0929 06:38:15.735082 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:15.735103 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:15.735153 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:15.735928 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:15.735929 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:15.735931 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:15.735974 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.735976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.737176 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.737177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.738231 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.738233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.739210 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.739211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.739279 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.739283 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:38:15.739477 (+ 194us) client_negotiation.cc:240] Negotiation successful
0929 06:38:15.739521 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":46,"threads_started":1}
I20260929 06:38:15.740109 17602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.735096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45774 (local address 127.15.157.131:38715)
0929 06:38:15.735730 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:15.735734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:15.735743 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:15.735794 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:15.735796 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:15.735811 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:15.735930 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:15.736033 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.737085 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.738306 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.739092 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.739881 (+ 789us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.739957 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:15.739983 (+ 26us) server_negotiation.cc:299] Negotiation successful
0929 06:38:15.740023 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":95,"threads_started":1}
I20260929 06:38:15.740011 17379 tablet_service.cc:1467] Processing CreateTablet for tablet 1d145aa4d3fd44f0a53caf03487bacba (DEFAULT_TABLE table=test-table [id=96d3ac331dc64427b500f724fce61675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:15.740200 17599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.734976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:42161 (local address 127.0.0.1:49382)
0929 06:38:15.735090 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:15.735100 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:15.735153 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:15.735716 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:15.735719 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:15.735721 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:15.735846 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.735848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.738300 (+ 2452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.738301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.738976 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.738977 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.739965 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.739966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.740028 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.740031 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:38:15.740101 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 06:38:15.740141 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":52,"threads_started":1}
I20260929 06:38:15.740388 17379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d145aa4d3fd44f0a53caf03487bacba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:15.740433 17603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.735320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49382 (local address 127.15.157.129:42161)
0929 06:38:15.735475 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:15.735480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:15.735492 (+ 12us) server_negotiation.cc:407] Connection header received
0929 06:38:15.735531 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:15.735533 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:15.735549 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:15.735636 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:15.735933 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.737091 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.739065 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.739805 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.739866 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.739932 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:15.740116 (+ 184us) server_negotiation.cc:299] Negotiation successful
0929 06:38:15.740148 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
I20260929 06:38:15.740751 17519 tablet_service.cc:1467] Processing CreateTablet for tablet 1d145aa4d3fd44f0a53caf03487bacba (DEFAULT_TABLE table=test-table [id=96d3ac331dc64427b500f724fce61675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:15.740949 17239 tablet_service.cc:1467] Processing CreateTablet for tablet 1d145aa4d3fd44f0a53caf03487bacba (DEFAULT_TABLE table=test-table [id=96d3ac331dc64427b500f724fce61675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:15.741072 17519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d145aa4d3fd44f0a53caf03487bacba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:15.741189 17239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d145aa4d3fd44f0a53caf03487bacba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:15.743872 17605 tablet_bootstrap.cc:492] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee: Bootstrap starting.
I20260929 06:38:15.744202 17607 tablet_bootstrap.cc:492] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803: Bootstrap starting.
I20260929 06:38:15.744622 17605 tablet_bootstrap.cc:654] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:15.744966 17605 log.cc:824] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:15.745074 17607 tablet_bootstrap.cc:654] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:15.745365 17607 log.cc:824] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:15.745693 17606 tablet_bootstrap.cc:492] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d: Bootstrap starting.
I20260929 06:38:15.745779 17605 tablet_bootstrap.cc:492] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee: No bootstrap required, opened a new log
I20260929 06:38:15.745829 17605 ts_tablet_manager.cc:1397] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:38:15.746258 17607 tablet_bootstrap.cc:492] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803: No bootstrap required, opened a new log
I20260929 06:38:15.746341 17607 ts_tablet_manager.cc:1397] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:38:15.746483 17606 tablet_bootstrap.cc:654] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:15.746794 17606 log.cc:824] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:15.747530 17606 tablet_bootstrap.cc:492] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d: No bootstrap required, opened a new log
I20260929 06:38:15.747596 17606 ts_tablet_manager.cc:1397] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 06:38:15.748026 17605 raft_consensus.cc:348] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.748167 17605 raft_consensus.cc:374] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:15.748189 17605 raft_consensus.cc:729] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812247faeab54380a2e739a3b6fbc0ee, State: Initialized, Role: FOLLOWER
I20260929 06:38:15.748457 17605 consensus_queue.cc:260] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.748483 17607 raft_consensus.cc:348] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.748646 17607 raft_consensus.cc:374] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:15.748690 17607 raft_consensus.cc:729] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc7006989f840db94051f90540ea803, State: Initialized, Role: FOLLOWER
I20260929 06:38:15.748706 17605 ts_tablet_manager.cc:1428] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:38:15.748858 17305 heartbeater.cc:503] Master 127.15.157.190:45757 was elected leader, sending a full tablet report...
I20260929 06:38:15.748824 17607 consensus_queue.cc:260] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.749089 17607 ts_tablet_manager.cc:1428] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:38:15.749226 17585 heartbeater.cc:503] Master 127.15.157.190:45757 was elected leader, sending a full tablet report...
I20260929 06:38:15.749900 17606 raft_consensus.cc:348] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.750063 17606 raft_consensus.cc:374] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:15.750101 17606 raft_consensus.cc:729] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a64f210c8564f299d7d8a8ae25c7c7d, State: Initialized, Role: FOLLOWER
I20260929 06:38:15.750207 17606 consensus_queue.cc:260] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.750456 17606 ts_tablet_manager.cc:1428] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260929 06:38:15.750494 17445 heartbeater.cc:503] Master 127.15.157.190:45757 was elected leader, sending a full tablet report...
W20260929 06:38:15.800433 17446 tablet.cc:2369] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:38:15.890151 17306 tablet.cc:2369] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:38:15.935985 17613 raft_consensus.cc:482] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:15.936100 17613 raft_consensus.cc:504] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.936434 17613 leader_election.cc:288] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812247faeab54380a2e739a3b6fbc0ee (127.15.157.129:42161), 5bc7006989f840db94051f90540ea803 (127.15.157.131:38715)
I20260929 06:38:15.939353 17602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.936736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:55291 (local address 127.15.157.131:38715)
0929 06:38:15.936808 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:15.936860 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:15.936868 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:15.936911 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:15.936912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:15.936920 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:15.936985 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:15.937155 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.937635 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.938645 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.939009 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.939096 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.939104 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:15.939254 (+ 150us) server_negotiation.cc:299] Negotiation successful
0929 06:38:15.939290 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260929 06:38:15.939353 17338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.936671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:38715 (local address 127.15.157.130:55291)
0929 06:38:15.936738 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:15.936770 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:15.936817 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:15.937001 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:15.937002 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:15.937004 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:15.937073 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.937075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.937717 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.937718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.938553 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.938554 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.939092 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.939093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.939170 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.939175 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:38:15.939246 (+ 71us) client_negotiation.cc:240] Negotiation successful
0929 06:38:15.939282 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260929 06:38:15.939488 17603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.936798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:58017 (local address 127.15.157.129:42161)
0929 06:38:15.936843 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:15.936845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:15.936957 (+ 112us) server_negotiation.cc:407] Connection header received
0929 06:38:15.937019 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:15.937021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:15.937029 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:15.937108 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:15.937280 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.937742 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.938759 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.939108 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.939198 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.939206 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:15.939367 (+ 161us) server_negotiation.cc:299] Negotiation successful
0929 06:38:15.939403 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:38:15.939677 17614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.936685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:42161 (local address 127.15.157.130:58017)
0929 06:38:15.936868 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:15.936883 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:15.936962 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:15.937113 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:15.937114 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:15.937126 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:15.937204 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.937205 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.937893 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.937894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.938671 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:15.938673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.939200 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.939201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:15.939284 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.939288 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:38:15.939360 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 06:38:15.939397 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":105,"threads_started":1}
I20260929 06:38:15.939669 17539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d145aa4d3fd44f0a53caf03487bacba" candidate_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc7006989f840db94051f90540ea803" is_pre_election: true
I20260929 06:38:15.939837 17539 raft_consensus.cc:2454] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a64f210c8564f299d7d8a8ae25c7c7d in term 0.
I20260929 06:38:15.940063 17332 leader_election.cc:302] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc7006989f840db94051f90540ea803, 7a64f210c8564f299d7d8a8ae25c7c7d; no voters:
I20260929 06:38:15.940045 17259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d145aa4d3fd44f0a53caf03487bacba" candidate_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812247faeab54380a2e739a3b6fbc0ee" is_pre_election: true
I20260929 06:38:15.940194 17259 raft_consensus.cc:2454] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a64f210c8564f299d7d8a8ae25c7c7d in term 0.
I20260929 06:38:15.940209 17613 raft_consensus.cc:2781] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:15.940286 17613 raft_consensus.cc:482] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:15.940321 17613 raft_consensus.cc:3037] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:15.941282 17613 raft_consensus.cc:504] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.941438 17613 leader_election.cc:288] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [CANDIDATE]: Term 1 election: Requested vote from peers 812247faeab54380a2e739a3b6fbc0ee (127.15.157.129:42161), 5bc7006989f840db94051f90540ea803 (127.15.157.131:38715)
I20260929 06:38:15.941576 17539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d145aa4d3fd44f0a53caf03487bacba" candidate_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc7006989f840db94051f90540ea803"
I20260929 06:38:15.941588 17259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d145aa4d3fd44f0a53caf03487bacba" candidate_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812247faeab54380a2e739a3b6fbc0ee"
I20260929 06:38:15.941661 17259 raft_consensus.cc:3037] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:15.941661 17539 raft_consensus.cc:3037] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:15.942512 17539 raft_consensus.cc:2454] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a64f210c8564f299d7d8a8ae25c7c7d in term 1.
I20260929 06:38:15.942512 17259 raft_consensus.cc:2454] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a64f210c8564f299d7d8a8ae25c7c7d in term 1.
I20260929 06:38:15.942677 17332 leader_election.cc:302] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc7006989f840db94051f90540ea803, 7a64f210c8564f299d7d8a8ae25c7c7d; no voters:
I20260929 06:38:15.942775 17613 raft_consensus.cc:2781] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:15.942924 17613 raft_consensus.cc:686] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [term 1 LEADER]: Becoming Leader. State: Replica: 7a64f210c8564f299d7d8a8ae25c7c7d, State: Running, Role: LEADER
I20260929 06:38:15.943022 17613 consensus_queue.cc:237] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.943848 17101 catalog_manager.cc:5495] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a64f210c8564f299d7d8a8ae25c7c7d (127.15.157.130). New cstate: current_term: 1 leader_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } health_report { overall_health: UNKNOWN } } }
W20260929 06:38:15.951428 17586 tablet.cc:2369] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:38:15.965634 17604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:15.962975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34296 (local address 127.15.157.130:39479)
0929 06:38:15.963027 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:15.963029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:15.963042 (+ 13us) server_negotiation.cc:407] Connection header received
0929 06:38:15.963142 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:15.963144 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:15.963178 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:15.963253 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:15.963423 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.963928 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.964762 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:15.964963 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:15.965042 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:15.965266 (+ 224us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:15.965368 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:15.965457 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:15.965500 (+ 43us) server_negotiation.cc:299] Negotiation successful
0929 06:38:15.965523 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 06:38:15.967501 17539 raft_consensus.cc:1261] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803 [term 1 FOLLOWER]: Refusing update from remote peer 7a64f210c8564f299d7d8a8ae25c7c7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:15.967504 17259 raft_consensus.cc:1261] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee [term 1 FOLLOWER]: Refusing update from remote peer 7a64f210c8564f299d7d8a8ae25c7c7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:15.967855 17615 consensus_queue.cc:1035] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:15.967989 17613 consensus_queue.cc:1035] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:15.970126 17618 mvcc.cc:205] Tried to move back new op lower bound from 7334559317880016896 to 7334559317783203840. Current Snapshot: MvccSnapshot[applied={T|T < 7334559317880016896}]
I20260929 06:38:15.970440 17619 mvcc.cc:205] Tried to move back new op lower bound from 7334559317880016896 to 7334559317783203840. Current Snapshot: MvccSnapshot[applied={T|T < 7334559317880016896}]
I20260929 06:38:15.974400 17102 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:15.974501 17102 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:15.975266 17102 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09: Sending DeleteTablet for 3 replicas of tablet 1d145aa4d3fd44f0a53caf03487bacba
I20260929 06:38:15.975620 17239 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d145aa4d3fd44f0a53caf03487bacba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:15 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:49382
I20260929 06:38:15.975629 17379 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d145aa4d3fd44f0a53caf03487bacba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:15 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:34280
I20260929 06:38:15.975654 17519 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d145aa4d3fd44f0a53caf03487bacba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:15 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:45774
I20260929 06:38:15.975864 17628 tablet_replica.cc:330] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d: stopping tablet replica
I20260929 06:38:15.975961 17628 raft_consensus.cc:2229] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:38:15.976052 17627 tablet_replica.cc:330] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee: stopping tablet replica
I20260929 06:38:15.976089 17628 raft_consensus.cc:2258] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:15.976269 17627 raft_consensus.cc:2229] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:15.976320 17102 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43642:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:38:15.976459 17102 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:15.976532 17628 ts_tablet_manager.cc:1905] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:15.976632 17627 raft_consensus.cc:2258] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:15.977130 17627 ts_tablet_manager.cc:1905] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:15.977734 17239 tablet_service.cc:1467] Processing CreateTablet for tablet d3fcc2b2c6bd456fbceb511816d1b0c7 (DEFAULT_TABLE table=test-table [id=d0aa9ba4ed4e475085e3c016a592ef33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:15.977869 17239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3fcc2b2c6bd456fbceb511816d1b0c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:15.978566 17379 tablet_service.cc:1467] Processing CreateTablet for tablet d3fcc2b2c6bd456fbceb511816d1b0c7 (DEFAULT_TABLE table=test-table [id=d0aa9ba4ed4e475085e3c016a592ef33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:15.978752 17379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3fcc2b2c6bd456fbceb511816d1b0c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:15.979161 17628 ts_tablet_manager.cc:1918] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:15.979233 17628 log.cc:1196] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/1d145aa4d3fd44f0a53caf03487bacba
I20260929 06:38:15.979542 17628 ts_tablet_manager.cc:1939] T 1d145aa4d3fd44f0a53caf03487bacba P 7a64f210c8564f299d7d8a8ae25c7c7d: Deleting consensus metadata
I20260929 06:38:15.979933 17629 tablet_replica.cc:330] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803: stopping tablet replica
I20260929 06:38:15.980049 17629 raft_consensus.cc:2229] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:15.980163 17629 raft_consensus.cc:2258] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:15.980545 17605 tablet_bootstrap.cc:492] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee: Bootstrap starting.
I20260929 06:38:15.980954 17627 ts_tablet_manager.cc:1918] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:15.981051 17629 ts_tablet_manager.cc:1905] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:15.981081 17627 log.cc:1196] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/wal/wals/1d145aa4d3fd44f0a53caf03487bacba
I20260929 06:38:15.981175 17087 catalog_manager.cc:4841] TS 7a64f210c8564f299d7d8a8ae25c7c7d (127.15.157.130:39479): tablet 1d145aa4d3fd44f0a53caf03487bacba (table test-table [id=96d3ac331dc64427b500f724fce61675]) successfully deleted
I20260929 06:38:15.981317 17519 tablet_service.cc:1467] Processing CreateTablet for tablet d3fcc2b2c6bd456fbceb511816d1b0c7 (DEFAULT_TABLE table=test-table [id=d0aa9ba4ed4e475085e3c016a592ef33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:15.981415 17519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3fcc2b2c6bd456fbceb511816d1b0c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:15.981561 17627 ts_tablet_manager.cc:1939] T 1d145aa4d3fd44f0a53caf03487bacba P 812247faeab54380a2e739a3b6fbc0ee: Deleting consensus metadata
I20260929 06:38:15.980962 17605 tablet_bootstrap.cc:654] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:15.982578 17607 tablet_bootstrap.cc:492] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803: Bootstrap starting.
I20260929 06:38:15.982583 17629 ts_tablet_manager.cc:1918] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:15.982662 17629 log.cc:1196] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/1d145aa4d3fd44f0a53caf03487bacba
I20260929 06:38:15.982921 17629 ts_tablet_manager.cc:1939] T 1d145aa4d3fd44f0a53caf03487bacba P 5bc7006989f840db94051f90540ea803: Deleting consensus metadata
I20260929 06:38:15.982988 17607 tablet_bootstrap.cc:654] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:15.983387 17088 catalog_manager.cc:4841] TS 5bc7006989f840db94051f90540ea803 (127.15.157.131:38715): tablet 1d145aa4d3fd44f0a53caf03487bacba (table test-table [id=96d3ac331dc64427b500f724fce61675]) successfully deleted
I20260929 06:38:15.983413 17606 tablet_bootstrap.cc:492] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d: Bootstrap starting.
I20260929 06:38:15.983474 17086 catalog_manager.cc:4841] TS 812247faeab54380a2e739a3b6fbc0ee (127.15.157.129:42161): tablet 1d145aa4d3fd44f0a53caf03487bacba (table test-table [id=96d3ac331dc64427b500f724fce61675]) successfully deleted
I20260929 06:38:15.983541 17607 tablet_bootstrap.cc:492] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803: No bootstrap required, opened a new log
I20260929 06:38:15.983579 17607 ts_tablet_manager.cc:1397] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:15.983721 17607 raft_consensus.cc:348] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.983791 17607 raft_consensus.cc:374] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:15.983789 17606 tablet_bootstrap.cc:654] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:15.983815 17607 raft_consensus.cc:729] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc7006989f840db94051f90540ea803, State: Initialized, Role: FOLLOWER
I20260929 06:38:15.983800 17605 tablet_bootstrap.cc:492] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee: No bootstrap required, opened a new log
I20260929 06:38:15.983855 17605 ts_tablet_manager.cc:1397] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260929 06:38:15.983861 17607 consensus_queue.cc:260] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.983952 17607 ts_tablet_manager.cc:1428] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:15.983989 17605 raft_consensus.cc:348] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.984050 17605 raft_consensus.cc:374] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:15.984068 17605 raft_consensus.cc:729] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812247faeab54380a2e739a3b6fbc0ee, State: Initialized, Role: FOLLOWER
I20260929 06:38:15.984104 17605 consensus_queue.cc:260] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.984218 17605 ts_tablet_manager.cc:1428] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:15.984740 17606 tablet_bootstrap.cc:492] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d: No bootstrap required, opened a new log
I20260929 06:38:15.984779 17606 ts_tablet_manager.cc:1397] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260929 06:38:15.984932 17606 raft_consensus.cc:348] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.984990 17606 raft_consensus.cc:374] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:15.985004 17606 raft_consensus.cc:729] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a64f210c8564f299d7d8a8ae25c7c7d, State: Initialized, Role: FOLLOWER
I20260929 06:38:15.985062 17606 consensus_queue.cc:260] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:15.985152 17606 ts_tablet_manager.cc:1428] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:16.110044 17611 raft_consensus.cc:482] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:16.110153 17611 raft_consensus.cc:504] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:16.110549 17611 leader_election.cc:288] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a64f210c8564f299d7d8a8ae25c7c7d (127.15.157.130:39479), 5bc7006989f840db94051f90540ea803 (127.15.157.131:38715)
I20260929 06:38:16.114449 17602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.110864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:48167 (local address 127.15.157.131:38715)
0929 06:38:16.110914 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:16.110916 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:16.111090 (+ 174us) server_negotiation.cc:407] Connection header received
0929 06:38:16.111130 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:16.111131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:16.111146 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:16.111202 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:16.111360 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.111993 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.113543 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.114118 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.114178 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.114185 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:16.114329 (+ 144us) server_negotiation.cc:299] Negotiation successful
0929 06:38:16.114379 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 06:38:16.114457 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.110755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:39479 (local address 127.15.157.129:60361)
0929 06:38:16.110976 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:16.110986 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:16.111041 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:16.111274 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:16.111275 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:16.111277 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:16.111353 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:16.111355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.112156 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.112157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:16.113373 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:16.113376 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.114132 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.114133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:16.114230 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.114249 (+ 19us) client_negotiation.cc:769] Sending connection context
0929 06:38:16.114311 (+ 62us) client_negotiation.cc:240] Negotiation successful
0929 06:38:16.114349 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":2,"thread_start_us":94,"threads_started":1}
I20260929 06:38:16.114485 17604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.110883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:60361 (local address 127.15.157.130:39479)
0929 06:38:16.110929 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:16.110931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:16.111055 (+ 124us) server_negotiation.cc:407] Connection header received
0929 06:38:16.111158 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:16.111159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:16.111172 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:16.111244 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:16.111432 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.112058 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.113448 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.114005 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.114100 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.114109 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:16.114324 (+ 215us) server_negotiation.cc:299] Negotiation successful
0929 06:38:16.114393 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:16.114730 17634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.110808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:38715 (local address 127.15.157.129:48167)
0929 06:38:16.110987 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:16.110996 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:16.111077 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:16.111216 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:16.111217 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:16.111219 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:16.111296 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:16.111301 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.112091 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.112092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:16.113417 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:16.113420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.114178 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.114179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:16.114257 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.114261 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:38:16.114594 (+ 333us) client_negotiation.cc:240] Negotiation successful
0929 06:38:16.114642 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":7,"thread_start_us":107,"threads_started":1}
I20260929 06:38:16.114735 17399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3fcc2b2c6bd456fbceb511816d1b0c7" candidate_uuid: "812247faeab54380a2e739a3b6fbc0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" is_pre_election: true
I20260929 06:38:16.114876 17399 raft_consensus.cc:2454] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812247faeab54380a2e739a3b6fbc0ee in term 0.
I20260929 06:38:16.114933 17539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3fcc2b2c6bd456fbceb511816d1b0c7" candidate_uuid: "812247faeab54380a2e739a3b6fbc0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc7006989f840db94051f90540ea803" is_pre_election: true
I20260929 06:38:16.115012 17539 raft_consensus.cc:2454] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812247faeab54380a2e739a3b6fbc0ee in term 0.
I20260929 06:38:16.115180 17192 leader_election.cc:302] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc7006989f840db94051f90540ea803, 812247faeab54380a2e739a3b6fbc0ee; no voters:
I20260929 06:38:16.115330 17611 raft_consensus.cc:2781] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:16.115376 17611 raft_consensus.cc:482] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:16.115391 17611 raft_consensus.cc:3037] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:16.116418 17611 raft_consensus.cc:504] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:16.116581 17611 leader_election.cc:288] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [CANDIDATE]: Term 1 election: Requested vote from peers 7a64f210c8564f299d7d8a8ae25c7c7d (127.15.157.130:39479), 5bc7006989f840db94051f90540ea803 (127.15.157.131:38715)
I20260929 06:38:16.116717 17539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3fcc2b2c6bd456fbceb511816d1b0c7" candidate_uuid: "812247faeab54380a2e739a3b6fbc0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc7006989f840db94051f90540ea803"
I20260929 06:38:16.116715 17399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3fcc2b2c6bd456fbceb511816d1b0c7" candidate_uuid: "812247faeab54380a2e739a3b6fbc0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d"
I20260929 06:38:16.116786 17539 raft_consensus.cc:3037] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:16.116787 17399 raft_consensus.cc:3037] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:16.117359 17539 raft_consensus.cc:2454] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812247faeab54380a2e739a3b6fbc0ee in term 1.
I20260929 06:38:16.117545 17192 leader_election.cc:302] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc7006989f840db94051f90540ea803, 812247faeab54380a2e739a3b6fbc0ee; no voters:
I20260929 06:38:16.117563 17399 raft_consensus.cc:2454] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812247faeab54380a2e739a3b6fbc0ee in term 1.
I20260929 06:38:16.117620 17611 raft_consensus.cc:2781] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:16.117760 17611 raft_consensus.cc:686] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [term 1 LEADER]: Becoming Leader. State: Replica: 812247faeab54380a2e739a3b6fbc0ee, State: Running, Role: LEADER
I20260929 06:38:16.117838 17611 consensus_queue.cc:237] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:16.118512 17102 catalog_manager.cc:5495] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 812247faeab54380a2e739a3b6fbc0ee (127.15.157.129). New cstate: current_term: 1 leader_uuid: "812247faeab54380a2e739a3b6fbc0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } health_report { overall_health: UNKNOWN } } }
Sep 29 06:38:16 dist-test-slave-ltw5 krb5kdc[17057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663895, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:16.161499 17642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.154715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45757 (local address 127.0.0.1:43650)
0929 06:38:16.154910 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:16.154920 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:16.154989 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:16.155116 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:16.155117 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:16.155412 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:16.155457 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:16.155458 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.156171 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.156172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:16.156688 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:16.156690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.157044 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.157045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:16.157092 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.157624 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:16.157628 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:16.159073 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:16.160464 (+ 1391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:16.160471 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:16.160472 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:16.160667 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:16.160872 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:16.160873 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:16.160873 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:16.160929 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:16.161186 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:16.161192 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:16.161237 (+ 45us) client_negotiation.cc:769] Sending connection context
0929 06:38:16.161303 (+ 66us) client_negotiation.cc:240] Negotiation successful
0929 06:38:16.161396 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":167,"threads_started":1}
I20260929 06:38:16.161572 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.154749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43650 (local address 127.15.157.190:45757)
0929 06:38:16.154896 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:16.154899 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:16.155002 (+ 103us) server_negotiation.cc:407] Connection header received
0929 06:38:16.155032 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:16.155033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:16.155043 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:16.155103 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:16.155570 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.156088 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.156770 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.156971 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.157048 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.159154 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:16.159155 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:16.159155 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:16.159161 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:16.160365 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:16.160748 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:16.160749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:16.160749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:16.160806 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:16.160986 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:16.160987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:16.160987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:16.161081 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:16.161169 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:16.161379 (+ 210us) server_negotiation.cc:299] Negotiation successful
0929 06:38:16.161444 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 06:38:16.163558 17102 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:43650:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260929 06:38:16.163774 17102 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:16.165247 17379 tablet_service.cc:1467] Processing CreateTablet for tablet 97cba670a5d4435cb0f1c88395776e7f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d406bf33477946ec8cdd5bc47d996352]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:38:16.165289 17239 tablet_service.cc:1467] Processing CreateTablet for tablet 97cba670a5d4435cb0f1c88395776e7f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d406bf33477946ec8cdd5bc47d996352]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:38:16.165272 17519 tablet_service.cc:1467] Processing CreateTablet for tablet 97cba670a5d4435cb0f1c88395776e7f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d406bf33477946ec8cdd5bc47d996352]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:38:16.165414 17519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97cba670a5d4435cb0f1c88395776e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:16.165413 17239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97cba670a5d4435cb0f1c88395776e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:16.165416 17379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97cba670a5d4435cb0f1c88395776e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:16.166728 17606 tablet_bootstrap.cc:492] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d: Bootstrap starting.
I20260929 06:38:16.166888 17607 tablet_bootstrap.cc:492] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803: Bootstrap starting.
I20260929 06:38:16.166898 17605 tablet_bootstrap.cc:492] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee: Bootstrap starting.
I20260929 06:38:16.167078 17606 tablet_bootstrap.cc:654] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:16.167294 17607 tablet_bootstrap.cc:654] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:16.167294 17605 tablet_bootstrap.cc:654] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:16.168030 17605 tablet_bootstrap.cc:492] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee: No bootstrap required, opened a new log
I20260929 06:38:16.168030 17606 tablet_bootstrap.cc:492] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d: No bootstrap required, opened a new log
I20260929 06:38:16.168084 17606 ts_tablet_manager.cc:1397] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260929 06:38:16.168084 17605 ts_tablet_manager.cc:1397] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:16.168201 17607 tablet_bootstrap.cc:492] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803: No bootstrap required, opened a new log
I20260929 06:38:16.168200 17606 raft_consensus.cc:348] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:16.168221 17605 raft_consensus.cc:348] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:16.168262 17606 raft_consensus.cc:374] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:16.168269 17607 ts_tablet_manager.cc:1397] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:16.168283 17606 raft_consensus.cc:729] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a64f210c8564f299d7d8a8ae25c7c7d, State: Initialized, Role: FOLLOWER
I20260929 06:38:16.168282 17605 raft_consensus.cc:374] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:16.168305 17605 raft_consensus.cc:729] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812247faeab54380a2e739a3b6fbc0ee, State: Initialized, Role: FOLLOWER
I20260929 06:38:16.168329 17606 consensus_queue.cc:260] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:16.168344 17605 consensus_queue.cc:260] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:16.168430 17605 ts_tablet_manager.cc:1428] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:16.168430 17606 ts_tablet_manager.cc:1428] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:16.168447 17607 raft_consensus.cc:348] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:16.168524 17607 raft_consensus.cc:374] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:16.168551 17607 raft_consensus.cc:729] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc7006989f840db94051f90540ea803, State: Initialized, Role: FOLLOWER
I20260929 06:38:16.168550 17615 tablet_replica.cc:439] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } } }
I20260929 06:38:16.168603 17607 consensus_queue.cc:260] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:16.168639 17615 tablet_replica.cc:442] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:16.168696 17607 ts_tablet_manager.cc:1428] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:16.168758 17612 tablet_replica.cc:439] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } } }
I20260929 06:38:16.168854 17612 tablet_replica.cc:442] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:16.168883 17611 tablet_replica.cc:439] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } } }
I20260929 06:38:16.168955 17611 tablet_replica.cc:442] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:16.366496 17615 raft_consensus.cc:482] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:16.366621 17615 raft_consensus.cc:504] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:16.366797 17615 leader_election.cc:288] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812247faeab54380a2e739a3b6fbc0ee (127.15.157.129:42161), 5bc7006989f840db94051f90540ea803 (127.15.157.131:38715)
I20260929 06:38:16.367060 17259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97cba670a5d4435cb0f1c88395776e7f" candidate_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812247faeab54380a2e739a3b6fbc0ee" is_pre_election: true
I20260929 06:38:16.367084 17539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97cba670a5d4435cb0f1c88395776e7f" candidate_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc7006989f840db94051f90540ea803" is_pre_election: true
I20260929 06:38:16.367173 17259 raft_consensus.cc:2454] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a64f210c8564f299d7d8a8ae25c7c7d in term 0.
I20260929 06:38:16.367168 17539 raft_consensus.cc:2454] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a64f210c8564f299d7d8a8ae25c7c7d in term 0.
I20260929 06:38:16.367357 17332 leader_election.cc:302] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc7006989f840db94051f90540ea803, 7a64f210c8564f299d7d8a8ae25c7c7d; no voters:
I20260929 06:38:16.367458 17615 raft_consensus.cc:2781] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:16.367514 17615 raft_consensus.cc:482] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:16.367566 17615 raft_consensus.cc:3037] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:16.368286 17615 raft_consensus.cc:504] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:16.368453 17615 leader_election.cc:288] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [CANDIDATE]: Term 1 election: Requested vote from peers 812247faeab54380a2e739a3b6fbc0ee (127.15.157.129:42161), 5bc7006989f840db94051f90540ea803 (127.15.157.131:38715)
I20260929 06:38:16.368569 17259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97cba670a5d4435cb0f1c88395776e7f" candidate_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812247faeab54380a2e739a3b6fbc0ee"
I20260929 06:38:16.368661 17259 raft_consensus.cc:3037] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:16.368629 17539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97cba670a5d4435cb0f1c88395776e7f" candidate_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc7006989f840db94051f90540ea803"
I20260929 06:38:16.368738 17539 raft_consensus.cc:3037] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:16.369261 17259 raft_consensus.cc:2454] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a64f210c8564f299d7d8a8ae25c7c7d in term 1.
I20260929 06:38:16.369457 17330 leader_election.cc:302] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a64f210c8564f299d7d8a8ae25c7c7d, 812247faeab54380a2e739a3b6fbc0ee; no voters:
I20260929 06:38:16.369575 17615 raft_consensus.cc:2781] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:16.369580 17539 raft_consensus.cc:2454] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a64f210c8564f299d7d8a8ae25c7c7d in term 1.
I20260929 06:38:16.369637 17615 raft_consensus.cc:686] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [term 1 LEADER]: Becoming Leader. State: Replica: 7a64f210c8564f299d7d8a8ae25c7c7d, State: Running, Role: LEADER
I20260929 06:38:16.369689 17615 consensus_queue.cc:237] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } }
I20260929 06:38:16.369972 17613 tablet_replica.cc:439] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d: TxnStatusTablet state changed. Reason: New leader 7a64f210c8564f299d7d8a8ae25c7c7d. Latest consensus state: current_term: 1 leader_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } } }
I20260929 06:38:16.370100 17613 tablet_replica.cc:442] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:38:16.370369 17647 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260929 06:38:16.370381 17102 catalog_manager.cc:5495] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a64f210c8564f299d7d8a8ae25c7c7d (127.15.157.130). New cstate: current_term: 1 leader_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } health_report { overall_health: UNKNOWN } } }
I20260929 06:38:16.370504 17647 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260929 06:38:16.395826 17604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.393452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34298 (local address 127.15.157.130:39479)
0929 06:38:16.393503 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:16.393505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:16.393515 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:38:16.393588 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:16.393589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:16.393600 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:16.393673 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:16.393794 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.394357 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.395122 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.395315 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.395391 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.395563 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:16.395604 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:16.395664 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:16.395726 (+ 62us) server_negotiation.cc:299] Negotiation successful
0929 06:38:16.395747 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 06:38:16.395866 17642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.393378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:39479 (local address 127.0.0.1:34298)
0929 06:38:16.393455 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:16.393468 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:16.393520 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:16.393680 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:16.393682 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:16.393683 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:38:16.393734 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:16.393736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.394439 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.394440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:16.395031 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:16.395033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.395391 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.395392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:16.395459 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.395480 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:38:16.395666 (+ 186us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:38:16.395674 (+ 8us) client_negotiation.cc:769] Sending connection context
0929 06:38:16.395722 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 06:38:16.395790 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 06:38:16.396871 17259 raft_consensus.cc:1261] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee [term 1 FOLLOWER]: Refusing update from remote peer 7a64f210c8564f299d7d8a8ae25c7c7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:16.396842 17539 raft_consensus.cc:1261] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803 [term 1 FOLLOWER]: Refusing update from remote peer 7a64f210c8564f299d7d8a8ae25c7c7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:16.397122 17613 consensus_queue.cc:1035] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:16.397257 17613 consensus_queue.cc:1035] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:16.397611 17611 tablet_replica.cc:439] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee: TxnStatusTablet state changed. Reason: New leader 7a64f210c8564f299d7d8a8ae25c7c7d. Latest consensus state: current_term: 1 leader_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } } }
I20260929 06:38:16.397699 17611 tablet_replica.cc:442] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:16.397792 17612 tablet_replica.cc:439] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803: TxnStatusTablet state changed. Reason: New leader 7a64f210c8564f299d7d8a8ae25c7c7d. Latest consensus state: current_term: 1 leader_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } } }
I20260929 06:38:16.397892 17612 tablet_replica.cc:442] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:16.398221 17615 tablet_replica.cc:439] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } } }
I20260929 06:38:16.398384 17615 tablet_replica.cc:442] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:38:16.398643 17611 tablet_replica.cc:439] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } } }
I20260929 06:38:16.398716 17611 tablet_replica.cc:442] T 97cba670a5d4435cb0f1c88395776e7f P 812247faeab54380a2e739a3b6fbc0ee: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:16.398806 17620 mvcc.cc:205] Tried to move back new op lower bound from 7334559319639760896 to 7334559319530590208. Current Snapshot: MvccSnapshot[applied={T|T < 7334559319639760896 or (T in {7334559319639760896})}]
I20260929 06:38:16.399405 17615 tablet_replica.cc:439] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } } }
I20260929 06:38:16.399482 17615 tablet_replica.cc:442] T 97cba670a5d4435cb0f1c88395776e7f P 7a64f210c8564f299d7d8a8ae25c7c7d: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:38:16.399952 17612 tablet_replica.cc:439] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812247faeab54380a2e739a3b6fbc0ee" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42161 } } peers { permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 } } peers { permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 } } }
I20260929 06:38:16.400036 17612 tablet_replica.cc:442] T 97cba670a5d4435cb0f1c88395776e7f P 5bc7006989f840db94051f90540ea803: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:16.402731 17603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.400451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49394 (local address 127.15.157.129:42161)
0929 06:38:16.400491 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:16.400493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:16.400499 (+ 6us) server_negotiation.cc:407] Connection header received
0929 06:38:16.400525 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:16.400526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:16.400551 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:16.400624 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:16.400745 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.401195 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.401901 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.402179 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.402251 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.402415 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:16.402520 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:16.402601 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:16.402642 (+ 41us) server_negotiation.cc:299] Negotiation successful
0929 06:38:16.402661 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:38:16.407470 17604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.405232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:37579 (local address 127.15.157.130:39479)
0929 06:38:16.405295 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:16.405297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:16.405306 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:16.405372 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:16.405373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:16.405382 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:16.405436 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:16.405569 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.406002 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.406795 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.406988 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.407066 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.407234 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:16.407268 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:16.407325 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:16.407386 (+ 61us) server_negotiation.cc:299] Negotiation successful
0929 06:38:16.407404 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 06:38:16.407660 17654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.405108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:39479 (local address 127.15.157.129:37579)
0929 06:38:16.405229 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:16.405238 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:16.405308 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:16.405439 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:16.405439 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:16.405441 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:38:16.405496 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:16.405497 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.406113 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.406114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:16.406700 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:16.406701 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.407068 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.407069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:16.407137 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.407149 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:38:16.407325 (+ 176us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:38:16.407327 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:38:16.407368 (+ 41us) client_negotiation.cc:240] Negotiation successful
0929 06:38:16.407411 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":74,"threads_started":1}
I20260929 06:38:16.409708 17539 raft_consensus.cc:1261] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803 [term 1 FOLLOWER]: Refusing update from remote peer 812247faeab54380a2e739a3b6fbc0ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:16.409783 17399 raft_consensus.cc:1261] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d [term 1 FOLLOWER]: Refusing update from remote peer 812247faeab54380a2e739a3b6fbc0ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:16.409945 17635 consensus_queue.cc:1035] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc7006989f840db94051f90540ea803" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 38715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:16.410063 17611 consensus_queue.cc:1035] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a64f210c8564f299d7d8a8ae25c7c7d" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:16.418324 17603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.415442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:50829 (local address 127.15.157.129:42161)
0929 06:38:16.415475 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:16.415477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:16.415520 (+ 43us) server_negotiation.cc:407] Connection header received
0929 06:38:16.415689 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:16.415691 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:16.415701 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:16.415728 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:16.415963 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.416387 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.417508 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.417796 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.417836 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.418070 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:16.418106 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:16.418166 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:16.418223 (+ 57us) server_negotiation.cc:299] Negotiation successful
0929 06:38:16.418244 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 06:38:16.418350 17659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.415264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:42161 (local address 127.15.157.130:50829)
0929 06:38:16.415463 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:16.415473 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:16.415603 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:16.415852 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:16.415853 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:16.415854 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:38:16.415895 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:16.415897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.416486 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.416487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:16.417399 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:16.417401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.417892 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.417893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:16.417947 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.417960 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:38:16.418176 (+ 216us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:38:16.418178 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:38:16.418219 (+ 41us) client_negotiation.cc:240] Negotiation successful
0929 06:38:16.418262 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":84,"threads_started":1}
I20260929 06:38:16.427363 17102 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:16.427466 17102 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:16.428073 17102 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 887f93e4215c46cb84e1db84aaa27e09: Sending DeleteTablet for 3 replicas of tablet d3fcc2b2c6bd456fbceb511816d1b0c7
I20260929 06:38:16.428339 17239 tablet_service.cc:1514] Processing DeleteTablet for tablet d3fcc2b2c6bd456fbceb511816d1b0c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:16 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:49382
I20260929 06:38:16.428438 17627 tablet_replica.cc:330] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee: stopping tablet replica
I20260929 06:38:16.428436 17519 tablet_service.cc:1514] Processing DeleteTablet for tablet d3fcc2b2c6bd456fbceb511816d1b0c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:16 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:45774
I20260929 06:38:16.428511 17627 raft_consensus.cc:2229] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:38:16.428520 17629 tablet_replica.cc:330] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803: stopping tablet replica
I20260929 06:38:16.428560 17629 raft_consensus.cc:2229] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:16.428598 17629 raft_consensus.cc:2258] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:16.428596 17627 raft_consensus.cc:2258] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:16.428874 17627 ts_tablet_manager.cc:1905] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:16.428966 17629 ts_tablet_manager.cc:1905] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:16.430722 17627 ts_tablet_manager.cc:1918] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:38:16.430790 17627 log.cc:1196] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-0/wal/wals/d3fcc2b2c6bd456fbceb511816d1b0c7
I20260929 06:38:16.430922 17629 ts_tablet_manager.cc:1918] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:38:16.430974 17629 log.cc:1196] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/d3fcc2b2c6bd456fbceb511816d1b0c7
I20260929 06:38:16.431048 17627 ts_tablet_manager.cc:1939] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 812247faeab54380a2e739a3b6fbc0ee: Deleting consensus metadata
I20260929 06:38:16.431191 17629 ts_tablet_manager.cc:1939] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 5bc7006989f840db94051f90540ea803: Deleting consensus metadata
I20260929 06:38:16.431361 17086 catalog_manager.cc:4841] TS 812247faeab54380a2e739a3b6fbc0ee (127.15.157.129:42161): tablet d3fcc2b2c6bd456fbceb511816d1b0c7 (table test-table [id=d0aa9ba4ed4e475085e3c016a592ef33]) successfully deleted
I20260929 06:38:16.431495 17379 tablet_service.cc:1514] Processing DeleteTablet for tablet d3fcc2b2c6bd456fbceb511816d1b0c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:16 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:34280
I20260929 06:38:16.431579 17628 tablet_replica.cc:330] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d: stopping tablet replica
I20260929 06:38:16.431629 17628 raft_consensus.cc:2229] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:16.431660 17628 raft_consensus.cc:2258] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:16.431777 17088 catalog_manager.cc:4841] TS 5bc7006989f840db94051f90540ea803 (127.15.157.131:38715): tablet d3fcc2b2c6bd456fbceb511816d1b0c7 (table test-table [id=d0aa9ba4ed4e475085e3c016a592ef33]) successfully deleted
I20260929 06:38:16.431991 17628 ts_tablet_manager.cc:1905] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:16.433408 17628 ts_tablet_manager.cc:1918] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:38:16.433463 17628 log.cc:1196] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/d3fcc2b2c6bd456fbceb511816d1b0c7
I20260929 06:38:16.433651 17628 ts_tablet_manager.cc:1939] T d3fcc2b2c6bd456fbceb511816d1b0c7 P 7a64f210c8564f299d7d8a8ae25c7c7d: Deleting consensus metadata
I20260929 06:38:16.434056 17087 catalog_manager.cc:4841] TS 7a64f210c8564f299d7d8a8ae25c7c7d (127.15.157.130:39479): tablet d3fcc2b2c6bd456fbceb511816d1b0c7 (table test-table [id=d0aa9ba4ed4e475085e3c016a592ef33]) successfully deleted
Sep 29 06:38:16 dist-test-slave-ltw5 krb5kdc[17057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663895, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.157.129@KRBTEST.COM
I20260929 06:38:16.443862 17603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.432565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49408 (local address 127.15.157.129:42161)
0929 06:38:16.432601 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:16.432603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:16.434178 (+ 1575us) server_negotiation.cc:407] Connection header received
0929 06:38:16.434277 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:16.434278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:16.434298 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:16.434362 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:16.435010 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.435721 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.436764 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.437058 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.437132 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.440531 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:16.440539 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:16.440540 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:16.440547 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:16.442569 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:16.442973 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:16.442977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:16.442977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:16.443062 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:16.443278 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:16.443279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:16.443280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:16.443445 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:16.443607 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:16.443674 (+ 67us) server_negotiation.cc:299] Negotiation successful
0929 06:38:16.443750 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260929 06:38:16.444365 17299 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49408
I20260929 06:38:16.452613 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:16.445310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43658 (local address 127.15.157.190:45757)
0929 06:38:16.445352 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:16.445354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:16.445362 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:16.445409 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:16.445410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:16.445419 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:16.445469 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:16.446066 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.446832 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.447835 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:16.448151 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:16.448217 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:16.449645 (+ 1428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:16.449646 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:16.449646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:16.449654 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:16.451362 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:16.451744 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:16.451745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:16.451745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:16.451805 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:16.452020 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:16.452021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:16.452021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:16.452146 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:16.452242 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:16.452378 (+ 136us) server_negotiation.cc:299] Negotiation successful
0929 06:38:16.452488 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260929 06:38:16.452906 17102 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43658
I20260929 06:38:16.453759 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 17174
I20260929 06:38:16.459232 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 17314
I20260929 06:38:16.464627 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 17454
I20260929 06:38:16.469198 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 17070
2026-09-29T06:38:16Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2559 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:16 dist-test-slave-ltw5 krb5kdc[17669](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:16 dist-test-slave-ltw5 krb5kdc[17669](info): set up 2 sockets
Sep 29 06:38:16 dist-test-slave-ltw5 krb5kdc[17669](info): commencing operation
krb5kdc: starting...
W20260929 06:38:17.489795 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.000s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:38:17 dist-test-slave-ltw5 krb5kdc[17669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:38:17.604856 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:36191
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:36191
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:17.684175 17682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:17.684424 17682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:17.684463 17682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:17.685609 17682 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:17.685676 17682 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260929 06:38:17.685702 17682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:17.685735 17682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:17.685760 17682 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:17.685789 17682 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:17.687291 17682 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:36191
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:36191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:17.687572 17682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:17.687793 17682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:17.692865 17690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:17.692878 17688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:17.693049 17682 server_base.cc:1034] running on GCE node
W20260929 06:38:17.692878 17687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:17.693445 17682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:17.693746 17682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:17.694928 17682 hybrid_clock.cc:648] HybridClock initialized: now 1790663897694890 us; error 60 us; skew 500 ppm
Sep 29 06:38:17 dist-test-slave-ltw5 krb5kdc[17669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663897, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:17.697345 17682 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:38:17.697793 17682 webserver.cc:460] Webserver started at http://127.15.157.190:46647/ using document root <none> and password file <none>
I20260929 06:38:17.697970 17682 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:17.698009 17682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:17.698169 17682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:17.699152 17682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "a866ba6e7804475db960526dd22c53a7"
format_stamp: "Formatted at 2026-09-29 06:38:17 on dist-test-slave-ltw5"
server_key: "b83c1a2fb42b8db6fb52c5874cc4504c"
server_key_iv: "813f8682413fa9dc2913b4083639b0ab"
server_key_version: "encryptionkey@0"
I20260929 06:38:17.699451 17682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "a866ba6e7804475db960526dd22c53a7"
format_stamp: "Formatted at 2026-09-29 06:38:17 on dist-test-slave-ltw5"
server_key: "b83c1a2fb42b8db6fb52c5874cc4504c"
server_key_iv: "813f8682413fa9dc2913b4083639b0ab"
server_key_version: "encryptionkey@0"
I20260929 06:38:17.700699 17682 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:38:17.701452 17697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:17.701613 17682 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:17.701695 17682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "a866ba6e7804475db960526dd22c53a7"
format_stamp: "Formatted at 2026-09-29 06:38:17 on dist-test-slave-ltw5"
server_key: "b83c1a2fb42b8db6fb52c5874cc4504c"
server_key_iv: "813f8682413fa9dc2913b4083639b0ab"
server_key_version: "encryptionkey@0"
I20260929 06:38:17.701747 17682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:17.726764 17682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:17.729102 17682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:17.729218 17682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:17.733642 17682 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:36191
I20260929 06:38:17.733732 17759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:36191 every 8 connection(s)
I20260929 06:38:17.734112 17682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:17.734812 17760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:17.737082 17760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7: Bootstrap starting.
I20260929 06:38:17.737677 17760 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:17.737974 17760 log.cc:824] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:17.738651 17760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7: No bootstrap required, opened a new log
I20260929 06:38:17.739605 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 17682
I20260929 06:38:17.739692 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:17.739861 15990 external_mini_cluster.cc:1428] Setting key 921630059e01a79cd178efad66ee7a66
I20260929 06:38:17.741290 17760 raft_consensus.cc:348] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a866ba6e7804475db960526dd22c53a7" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 36191 } }
I20260929 06:38:17.741457 17760 raft_consensus.cc:374] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:17.741500 17760 raft_consensus.cc:729] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a866ba6e7804475db960526dd22c53a7, State: Initialized, Role: FOLLOWER
I20260929 06:38:17.741634 17760 consensus_queue.cc:260] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a866ba6e7804475db960526dd22c53a7" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 36191 } }
I20260929 06:38:17.741720 17760 raft_consensus.cc:388] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:17.741763 17760 raft_consensus.cc:482] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:17.741837 17760 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:17.742465 17760 raft_consensus.cc:504] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a866ba6e7804475db960526dd22c53a7" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 36191 } }
I20260929 06:38:17.742584 17760 leader_election.cc:302] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a866ba6e7804475db960526dd22c53a7; no voters:
I20260929 06:38:17.742760 17760 leader_election.cc:288] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:17.742805 17765 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:17.742925 17765 raft_consensus.cc:686] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [term 1 LEADER]: Becoming Leader. State: Replica: a866ba6e7804475db960526dd22c53a7, State: Running, Role: LEADER
I20260929 06:38:17.743029 17760 sys_catalog.cc:564] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:17.743014 17765 consensus_queue.cc:237] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a866ba6e7804475db960526dd22c53a7" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 36191 } }
I20260929 06:38:17.743345 17765 sys_catalog.cc:455] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a866ba6e7804475db960526dd22c53a7. Latest consensus state: current_term: 1 leader_uuid: "a866ba6e7804475db960526dd22c53a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a866ba6e7804475db960526dd22c53a7" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 36191 } } }
I20260929 06:38:17.743463 17765 sys_catalog.cc:458] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:17.743508 17767 sys_catalog.cc:455] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a866ba6e7804475db960526dd22c53a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a866ba6e7804475db960526dd22c53a7" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 36191 } } }
I20260929 06:38:17.743683 17771 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:17.743685 17767 sys_catalog.cc:458] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:17.744210 17771 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:17.745750 17771 catalog_manager.cc:1347] Generated new cluster ID: 6921c67173ee4d839e327c3926490f80
I20260929 06:38:17.745798 17771 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:38:17 dist-test-slave-ltw5 krb5kdc[17669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:17.751006 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:17.740427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44748 (local address 127.15.157.190:36191)
0929 06:38:17.740590 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:17.740600 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:17.740706 (+ 106us) server_negotiation.cc:407] Connection header received
0929 06:38:17.741269 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:17.741275 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:17.741323 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:17.741488 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:17.742289 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:17.743523 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:17.744684 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:17.745262 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:17.745674 (+ 412us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:17.747721 (+ 2047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:17.747725 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:17.747725 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:17.747736 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:17.749434 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:17.749813 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:17.749818 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:17.749819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:17.749913 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:17.750160 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:17.750160 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:17.750161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:17.750398 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:17.750562 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:17.750670 (+ 108us) server_negotiation.cc:299] Negotiation successful
0929 06:38:17.750808 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":73,"threads_started":1}
I20260929 06:38:17.756409 17771 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:17.756906 17771 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:17.764122 17771 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7: Generated new TSK 0
I20260929 06:38:17.764307 17771 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:38:17.797415 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:36191
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:17.877243 17786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:17.877467 17786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:17.877494 17786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:17.878639 17786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:17.878677 17786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:17.878698 17786 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260929 06:38:17.878710 17786 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:38:17.878727 17786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:17.880137 17786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.157.190:36191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:17.880337 17786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:17.880522 17786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:17.885475 17794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:17.885474 17791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:17.885738 17786 server_base.cc:1034] running on GCE node
W20260929 06:38:17.885828 17792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:17.886091 17786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:17.886348 17786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:17.887485 17786 hybrid_clock.cc:648] HybridClock initialized: now 1790663897887463 us; error 37 us; skew 500 ppm
Sep 29 06:38:17 dist-test-slave-ltw5 krb5kdc[17669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663897, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:17.890105 17786 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:38:17.890611 17786 webserver.cc:460] Webserver started at http://127.15.157.129:32807/ using document root <none> and password file <none>
I20260929 06:38:17.890810 17786 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:17.890849 17786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:17.890940 17786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:17.891999 17786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "d224ae95c2fb4233a22c9133798e3c38"
format_stamp: "Formatted at 2026-09-29 06:38:17 on dist-test-slave-ltw5"
server_key: "c9b0828df4765aab36443d79433aa1a1"
server_key_iv: "2c40046d60563abe750f9d49b14ab683"
server_key_version: "encryptionkey@0"
I20260929 06:38:17.892299 17786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "d224ae95c2fb4233a22c9133798e3c38"
format_stamp: "Formatted at 2026-09-29 06:38:17 on dist-test-slave-ltw5"
server_key: "c9b0828df4765aab36443d79433aa1a1"
server_key_iv: "2c40046d60563abe750f9d49b14ab683"
server_key_version: "encryptionkey@0"
I20260929 06:38:17.893523 17786 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:17.894223 17801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:17.894392 17786 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:17.894500 17786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "d224ae95c2fb4233a22c9133798e3c38"
format_stamp: "Formatted at 2026-09-29 06:38:17 on dist-test-slave-ltw5"
server_key: "c9b0828df4765aab36443d79433aa1a1"
server_key_iv: "2c40046d60563abe750f9d49b14ab683"
server_key_version: "encryptionkey@0"
I20260929 06:38:17.894573 17786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:17.920745 17786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:17.923277 17786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:17.923465 17786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:17.923998 17786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:17.924064 17786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:17.924111 17786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:17.924157 17786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 06:38:17 dist-test-slave-ltw5 krb5kdc[17669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663897, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:17.931406 17786 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:43037
I20260929 06:38:17.931717 17916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:43037 every 8 connection(s)
I20260929 06:38:17.931831 17786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:38:17.932246 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 17786
I20260929 06:38:17.932341 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:38:17.932559 15990 external_mini_cluster.cc:1428] Setting key e39aa8a7de5c70811c6e175369108b8b
I20260929 06:38:17.934767 17810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:17.924617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:36191 (local address 127.15.157.129:45927)
0929 06:38:17.924776 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:17.924813 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:17.925290 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:17.925578 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:17.925582 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:17.925974 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:17.926248 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:17.926253 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:17.927101 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:17.927102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:17.928009 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:17.928012 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:17.928460 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:17.928461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:17.928585 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:17.929120 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:17.929128 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:17.931334 (+ 2206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:17.933200 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:17.933206 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:17.933208 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:17.933432 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:17.933640 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:17.933641 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:17.933642 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:17.933751 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:17.934040 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:17.934047 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:17.934203 (+ 156us) client_negotiation.cc:769] Sending connection context
0929 06:38:17.934325 (+ 122us) client_negotiation.cc:240] Negotiation successful
0929 06:38:17.934513 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":93,"threads_started":1}
I20260929 06:38:17.935111 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:17.924618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:45927 (local address 127.15.157.190:36191)
0929 06:38:17.924663 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:17.924665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:17.924900 (+ 235us) server_negotiation.cc:407] Connection header received
0929 06:38:17.925393 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:17.925394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:17.925412 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:17.925482 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:17.926351 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:17.927005 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:17.928111 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:17.928363 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:17.928443 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:17.931437 (+ 2994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:17.931438 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:17.931438 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:17.931446 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:17.933100 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:17.933509 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:17.933510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:17.933511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:17.933568 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:17.933826 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:17.933827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:17.933827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:17.933953 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:17.934043 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:17.934923 (+ 880us) server_negotiation.cc:299] Negotiation successful
0929 06:38:17.935017 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:17.938088 17917 heartbeater.cc:347] Connected to a master server at 127.15.157.190:36191
I20260929 06:38:17.938179 17917 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:17.938356 17917 heartbeater.cc:511] Master 127.15.157.190:36191 requested a full tablet report, sending...
I20260929 06:38:17.938920 17713 ts_manager.cc:194] Registered new tserver with Master: d224ae95c2fb4233a22c9133798e3c38 (127.15.157.129:43037)
I20260929 06:38:17.939853 17713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:45927
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
I20260929 06:38:17.942698 17924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:17.936494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:36191 (local address 127.15.157.129:37699)
0929 06:38:17.936648 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:17.936665 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:17.936712 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:17.936836 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:17.936836 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:17.936980 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:17.937024 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:17.937025 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:17.938014 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:17.938057 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:17.938821 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:17.938823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:17.939203 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:17.939204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:17.939284 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:17.939726 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:17.939731 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:17.940059 (+ 328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:17.941754 (+ 1695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:17.941754 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:17.941755 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:17.941919 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:17.942121 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:17.942122 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:17.942122 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:17.942168 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:17.942457 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:17.942458 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:17.942501 (+ 43us) client_negotiation.cc:769] Sending connection context
0929 06:38:17.942557 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 06:38:17.942629 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":66,"threads_started":1}
I20260929 06:38:17.942714 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:17.936566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:37699 (local address 127.15.157.190:36191)
0929 06:38:17.936611 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:17.936613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:17.936725 (+ 112us) server_negotiation.cc:407] Connection header received
0929 06:38:17.936751 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:17.936752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:17.936763 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:17.936835 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:17.937095 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:17.937914 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:17.938917 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:17.939121 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:17.939204 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:17.940167 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:17.940168 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:17.940169 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:17.940175 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:17.941688 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:17.941977 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:17.941978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:17.941978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:17.942066 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:17.942219 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:17.942220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:17.942220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:17.942337 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:17.942421 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:17.942598 (+ 177us) server_negotiation.cc:299] Negotiation successful
0929 06:38:17.942658 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:38:17.958763 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:36191
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:18.038256 17926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:18.038494 17926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:18.038534 17926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:18.039712 17926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:18.039780 17926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:18.039814 17926 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260929 06:38:18.039844 17926 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:38:18.039876 17926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:18.041333 17926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.157.190:36191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:18.041606 17926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:18.041839 17926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:18.046922 17931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:18.046988 17932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:18.046940 17934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:18.047233 17926 server_base.cc:1034] running on GCE node
I20260929 06:38:18.047482 17926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:18.047751 17926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:18.048928 17926 hybrid_clock.cc:648] HybridClock initialized: now 1790663898048903 us; error 45 us; skew 500 ppm
Sep 29 06:38:18 dist-test-slave-ltw5 krb5kdc[17669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663898, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:18.051505 17926 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:38:18.052107 17926 webserver.cc:460] Webserver started at http://127.15.157.130:43249/ using document root <none> and password file <none>
I20260929 06:38:18.052366 17926 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:18.052435 17926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:18.052570 17926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:18.053718 17926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "77d69623f6454c198ca53ba2fbe5fc37"
format_stamp: "Formatted at 2026-09-29 06:38:18 on dist-test-slave-ltw5"
server_key: "657e5a47f842c86605223046b7665ddf"
server_key_iv: "1c72f8b0e7f29a6a00ad5c068572d839"
server_key_version: "encryptionkey@0"
I20260929 06:38:18.054148 17926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "77d69623f6454c198ca53ba2fbe5fc37"
format_stamp: "Formatted at 2026-09-29 06:38:18 on dist-test-slave-ltw5"
server_key: "657e5a47f842c86605223046b7665ddf"
server_key_iv: "1c72f8b0e7f29a6a00ad5c068572d839"
server_key_version: "encryptionkey@0"
I20260929 06:38:18.055454 17926 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:18.056169 17941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:18.056356 17926 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:18.056453 17926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "77d69623f6454c198ca53ba2fbe5fc37"
format_stamp: "Formatted at 2026-09-29 06:38:18 on dist-test-slave-ltw5"
server_key: "657e5a47f842c86605223046b7665ddf"
server_key_iv: "1c72f8b0e7f29a6a00ad5c068572d839"
server_key_version: "encryptionkey@0"
I20260929 06:38:18.056540 17926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:18.075152 17926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:18.077646 17926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:18.077821 17926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:18.078408 17926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:18.078470 17926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:18.078516 17926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:18.078544 17926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:18.085528 17926 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:35935
I20260929 06:38:18.085598 18056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:35935 every 8 connection(s)
Sep 29 06:38:18 dist-test-slave-ltw5 krb5kdc[17669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663898, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:18.085891 17926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:38:18.088972 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.079034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:53853 (local address 127.15.157.190:36191)
0929 06:38:18.079085 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.079086 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.079331 (+ 245us) server_negotiation.cc:407] Connection header received
0929 06:38:18.079914 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.079915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.079931 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.080008 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:18.080917 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.081738 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.083521 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.083715 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.083769 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.086138 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:18.086139 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:18.086140 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:18.086147 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:18.087614 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:18.088018 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:18.088019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:18.088020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:18.088075 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:18.088325 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:18.088325 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:18.088326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:18.088447 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:18.088522 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.088795 (+ 273us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.088885 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:38:18.089138 17950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.079025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:36191 (local address 127.15.157.130:53853)
0929 06:38:18.079203 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.079239 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.079746 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.080132 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.080137 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.080521 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:18.080808 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.080814 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.081905 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.081907 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.083413 (+ 1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.083416 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.083802 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.083802 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.083979 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.084568 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:18.084576 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:18.085989 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:18.087715 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:18.087720 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:18.087722 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:18.087941 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:18.088150 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:18.088150 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:18.088151 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:18.088257 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:18.088514 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:18.088520 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:18.088655 (+ 135us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.088757 (+ 102us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.088905 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
I20260929 06:38:18.089622 18057 heartbeater.cc:347] Connected to a master server at 127.15.157.190:36191
I20260929 06:38:18.089704 18057 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:18.089888 18057 heartbeater.cc:511] Master 127.15.157.190:36191 requested a full tablet report, sending...
I20260929 06:38:18.090273 17714 ts_manager.cc:194] Registered new tserver with Master: 77d69623f6454c198ca53ba2fbe5fc37 (127.15.157.130:35935)
I20260929 06:38:18.090752 17714 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:53853
I20260929 06:38:18.093374 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 17926
I20260929 06:38:18.093457 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:38:18.093650 15990 external_mini_cluster.cc:1428] Setting key 4f54706dd268e24c2f081a6c9d4c77f5
I20260929 06:38:18.096271 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.090675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:41107 (local address 127.15.157.190:36191)
0929 06:38:18.090738 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.090740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.090811 (+ 71us) server_negotiation.cc:407] Connection header received
0929 06:38:18.090906 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.090907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.090917 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.090966 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:18.091269 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.091731 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.092427 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.092624 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.092704 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.093655 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:18.093656 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:18.093656 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:18.093663 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:18.095119 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:18.095463 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:18.095464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:18.095465 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:18.095517 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:18.095717 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:18.095718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:18.095718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:18.095867 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:18.095957 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.096107 (+ 150us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.096178 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 06:38:18.096284 18063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.090639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:36191 (local address 127.15.157.130:41107)
0929 06:38:18.090758 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.090768 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.090825 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.090969 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.090969 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.091143 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:18.091186 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.091188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.091821 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.091822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.092325 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.092327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.092706 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.092707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.092779 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.093225 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:18.093230 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:18.093556 (+ 326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:18.095203 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:18.095203 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:18.095204 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:18.095373 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:18.095590 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:18.095591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:18.095591 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:18.095646 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:18.095952 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:18.095953 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:18.095997 (+ 44us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.096083 (+ 86us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.096179 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":70,"threads_started":1}
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:38:18.118587 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:36191
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:18.200785 18066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:18.201001 18066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:18.201025 18066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:18.202458 18066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:18.202505 18066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:18.202527 18066 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260929 06:38:18.202539 18066 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:38:18.202556 18066 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:18.204100 18066 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.157.190:36191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:18.204352 18066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:18.204605 18066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:38:18.209826 18066 server_base.cc:1034] running on GCE node
W20260929 06:38:18.209834 18071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:18.209844 18072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:18.209996 18074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:18.210196 18066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:18.210480 18066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:18.211644 18066 hybrid_clock.cc:648] HybridClock initialized: now 1790663898211648 us; error 44 us; skew 500 ppm
Sep 29 06:38:18 dist-test-slave-ltw5 krb5kdc[17669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663898, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:18.214283 18066 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:38:18.214771 18066 webserver.cc:460] Webserver started at http://127.15.157.131:35739/ using document root <none> and password file <none>
I20260929 06:38:18.214998 18066 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:18.215065 18066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:18.215215 18066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:18.216276 18066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "47a91ad02eb94d969eb6e9b33875a599"
format_stamp: "Formatted at 2026-09-29 06:38:18 on dist-test-slave-ltw5"
server_key: "48d9c08e5388cfe2c564352f815eeafb"
server_key_iv: "beade1947caecf6c5c5d1d48fa8080fc"
server_key_version: "encryptionkey@0"
I20260929 06:38:18.216647 18066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "47a91ad02eb94d969eb6e9b33875a599"
format_stamp: "Formatted at 2026-09-29 06:38:18 on dist-test-slave-ltw5"
server_key: "48d9c08e5388cfe2c564352f815eeafb"
server_key_iv: "beade1947caecf6c5c5d1d48fa8080fc"
server_key_version: "encryptionkey@0"
I20260929 06:38:18.217983 18066 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:38:18.218806 18081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:18.218981 18066 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:18.219075 18066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "47a91ad02eb94d969eb6e9b33875a599"
format_stamp: "Formatted at 2026-09-29 06:38:18 on dist-test-slave-ltw5"
server_key: "48d9c08e5388cfe2c564352f815eeafb"
server_key_iv: "beade1947caecf6c5c5d1d48fa8080fc"
server_key_version: "encryptionkey@0"
I20260929 06:38:18.219156 18066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:18.231154 18066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:18.233548 18066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:18.233711 18066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:18.234357 18066 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:18.234406 18066 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:18.234473 18066 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:18.234501 18066 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 06:38:18 dist-test-slave-ltw5 krb5kdc[17669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663898, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:18.242007 18066 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:35391
I20260929 06:38:18.242100 18196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:35391 every 8 connection(s)
I20260929 06:38:18.242537 18066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:38:18.244374 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 18066
I20260929 06:38:18.244464 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:38:18.244611 15990 external_mini_cluster.cc:1428] Setting key 62f3eaa479a2e5c8ef4e1f05ab74c0d1
I20260929 06:38:18.244606 18090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.234775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:36191 (local address 127.15.157.131:56869)
0929 06:38:18.234954 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.235007 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.235727 (+ 720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.236078 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.236082 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.236478 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:18.236784 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.236791 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.237557 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.237558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.238494 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.238497 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.238869 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.238870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.239046 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.239606 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:18.239617 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:18.241220 (+ 1603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:18.243079 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:18.243082 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:18.243084 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:18.243448 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:18.243611 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:18.243612 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:18.243612 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:18.243744 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:18.243974 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:18.243978 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:18.244090 (+ 112us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.244208 (+ 118us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.244345 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260929 06:38:18.245044 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.234759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:56869 (local address 127.15.157.190:36191)
0929 06:38:18.234807 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.234809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.235114 (+ 305us) server_negotiation.cc:407] Connection header received
0929 06:38:18.235874 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.235876 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.235904 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.235984 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:18.236916 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.237465 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.238597 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.238773 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.238857 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.241309 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:18.241311 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:18.241311 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:18.241319 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:18.242999 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:18.243517 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:18.243518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:18.243518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:18.243569 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:18.243805 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:18.243805 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:18.243805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:18.243900 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:18.243961 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.244879 (+ 918us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.244956 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:38:18.246083 18197 heartbeater.cc:347] Connected to a master server at 127.15.157.190:36191
I20260929 06:38:18.246160 18197 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:18.246325 18197 heartbeater.cc:511] Master 127.15.157.190:36191 requested a full tablet report, sending...
I20260929 06:38:18.246652 17712 ts_manager.cc:194] Registered new tserver with Master: 47a91ad02eb94d969eb6e9b33875a599 (127.15.157.131:35391)
I20260929 06:38:18.247032 17712 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:56869
I20260929 06:38:18.251616 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.246280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:59325 (local address 127.15.157.190:36191)
0929 06:38:18.246322 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.246324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.246451 (+ 127us) server_negotiation.cc:407] Connection header received
0929 06:38:18.246478 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.246478 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.246487 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.246552 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:18.246900 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.247446 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.248139 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.248331 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.248404 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.249319 (+ 915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:18.249320 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:18.249321 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:18.249327 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:18.250530 (+ 1203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:18.250880 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:18.250882 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:18.250882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:18.250938 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:18.251129 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:18.251130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:18.251130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:18.251234 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:18.251308 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.251456 (+ 148us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.251526 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:38:18.251637 18203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.246223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:36191 (local address 127.15.157.131:59325)
0929 06:38:18.246332 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.246343 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.246404 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.246557 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.246558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.246730 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:18.246811 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.246812 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.247530 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.247531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.248044 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.248045 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.248415 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.248416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.248485 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.248924 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:18.248929 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:18.249204 (+ 275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:18.250626 (+ 1422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:18.250627 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:18.250628 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:18.250792 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:18.251002 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:18.251003 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:18.251003 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:18.251058 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:18.251300 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:18.251300 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:18.251344 (+ 44us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.251432 (+ 88us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.251528 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":63,"threads_started":1}
I20260929 06:38:18.256313 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 06:38:18 dist-test-slave-ltw5 krb5kdc[17669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 06:38:18 dist-test-slave-ltw5 krb5kdc[17669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:18.278993 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.271956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44758 (local address 127.15.157.190:36191)
0929 06:38:18.272025 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.272026 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.272036 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:38:18.272092 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.272093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.272102 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.272154 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:18.272726 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.273201 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.273936 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.274217 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.274282 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.276625 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:18.276626 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:18.276627 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:18.276635 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:18.277797 (+ 1162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:18.278227 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:18.278229 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:18.278229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:18.278288 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:18.278488 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:18.278489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:18.278490 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:18.278600 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:18.278701 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.278804 (+ 103us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.278885 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 06:38:18.280445 17712 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44758:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:38:18.282007 17712 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:18.288854 18218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.284458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:35935 (local address 127.0.0.1:34036)
0929 06:38:18.284981 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.284988 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.285058 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.285355 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.285356 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.285358 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:18.285421 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.285422 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.286667 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.286668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.287587 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.287589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.288525 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.288526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.288599 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.288615 (+ 16us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.288694 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.288744 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":62,"threads_started":1}
I20260929 06:38:18.288868 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.284221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:43037 (local address 127.0.0.1:44608)
0929 06:38:18.284578 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.284618 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.284685 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.284954 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.284957 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.284960 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:18.285012 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.285013 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.286429 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.286430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.287706 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.287708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.288609 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.288610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.288664 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.288689 (+ 25us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.288742 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.288779 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"mutex_wait_us":1,"thread_start_us":58,"threads_started":1}
I20260929 06:38:18.289124 18215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.284288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:35391 (local address 127.0.0.1:48642)
0929 06:38:18.284589 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.284621 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.284683 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.285364 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.285365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.285366 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:18.285421 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.285422 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.287188 (+ 1766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.287189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.288087 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.288088 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.288907 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.288908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.288970 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.288974 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.289029 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.289066 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":22,"thread_start_us":74,"threads_started":1}
I20260929 06:38:18.289179 18216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.284388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48642 (local address 127.15.157.131:35391)
0929 06:38:18.285166 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.285171 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.285180 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:18.285216 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.285219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.285232 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.285303 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:18.286101 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.287096 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.288168 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.288753 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.288815 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.288863 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.289043 (+ 180us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.289076 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":747,"thread_start_us":90,"threads_started":1}
I20260929 06:38:18.289191 18217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.284411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44608 (local address 127.15.157.129:43037)
0929 06:38:18.284778 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.284783 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.284792 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:18.284837 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.284838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.284851 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.284915 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:18.285152 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.286338 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.287800 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.288457 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.288518 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.288573 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.288905 (+ 332us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.289106 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":79,"threads_started":1}
I20260929 06:38:18.289845 18219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.284577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34036 (local address 127.15.157.130:35935)
0929 06:38:18.284751 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.284756 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.285093 (+ 337us) server_negotiation.cc:407] Connection header received
0929 06:38:18.285147 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.285149 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.285165 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.285361 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:18.285489 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.286581 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.287671 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.288435 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.288518 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.288573 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.288719 (+ 146us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.288770 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":83,"threads_started":1}
I20260929 06:38:18.289875 18131 tablet_service.cc:1467] Processing CreateTablet for tablet 8ff62ded080a4798af256e39297f7791 (DEFAULT_TABLE table=test-table [id=0f43caa4a3c74aada36e0cdb45b6f776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:18.289873 17851 tablet_service.cc:1467] Processing CreateTablet for tablet 8ff62ded080a4798af256e39297f7791 (DEFAULT_TABLE table=test-table [id=0f43caa4a3c74aada36e0cdb45b6f776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:18.290262 17851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ff62ded080a4798af256e39297f7791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:18.290267 18131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ff62ded080a4798af256e39297f7791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:18.290429 17991 tablet_service.cc:1467] Processing CreateTablet for tablet 8ff62ded080a4798af256e39297f7791 (DEFAULT_TABLE table=test-table [id=0f43caa4a3c74aada36e0cdb45b6f776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:18.290752 17991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ff62ded080a4798af256e39297f7791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:18.293349 18220 tablet_bootstrap.cc:492] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38: Bootstrap starting.
I20260929 06:38:18.293797 18221 tablet_bootstrap.cc:492] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: Bootstrap starting.
I20260929 06:38:18.294097 18220 tablet_bootstrap.cc:654] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:18.294401 18222 tablet_bootstrap.cc:492] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37: Bootstrap starting.
I20260929 06:38:18.294461 18220 log.cc:824] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:18.294826 18221 tablet_bootstrap.cc:654] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:18.295011 18222 tablet_bootstrap.cc:654] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:18.295161 18221 log.cc:824] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:18.295270 18220 tablet_bootstrap.cc:492] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38: No bootstrap required, opened a new log
I20260929 06:38:18.295341 18220 ts_tablet_manager.cc:1397] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:38:18.295333 18222 log.cc:824] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:18.296104 18222 tablet_bootstrap.cc:492] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37: No bootstrap required, opened a new log
I20260929 06:38:18.296132 18221 tablet_bootstrap.cc:492] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: No bootstrap required, opened a new log
I20260929 06:38:18.296173 18222 ts_tablet_manager.cc:1397] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:38:18.296207 18221 ts_tablet_manager.cc:1397] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:38:18.297470 18220 raft_consensus.cc:348] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.297686 18220 raft_consensus.cc:374] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:18.297722 18220 raft_consensus.cc:729] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d224ae95c2fb4233a22c9133798e3c38, State: Initialized, Role: FOLLOWER
I20260929 06:38:18.297837 18220 consensus_queue.cc:260] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.297783 18221 raft_consensus.cc:348] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.297960 18221 raft_consensus.cc:374] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:18.298002 18221 raft_consensus.cc:729] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a91ad02eb94d969eb6e9b33875a599, State: Initialized, Role: FOLLOWER
I20260929 06:38:18.298136 18220 ts_tablet_manager.cc:1428] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:38:18.298166 18221 consensus_queue.cc:260] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.298285 17917 heartbeater.cc:503] Master 127.15.157.190:36191 was elected leader, sending a full tablet report...
I20260929 06:38:18.298189 18222 raft_consensus.cc:348] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.298326 18222 raft_consensus.cc:374] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:18.298365 18222 raft_consensus.cc:729] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d69623f6454c198ca53ba2fbe5fc37, State: Initialized, Role: FOLLOWER
I20260929 06:38:18.298473 18221 ts_tablet_manager.cc:1428] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:38:18.298480 18222 consensus_queue.cc:260] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.298583 18197 heartbeater.cc:503] Master 127.15.157.190:36191 was elected leader, sending a full tablet report...
I20260929 06:38:18.298738 18222 ts_tablet_manager.cc:1428] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:38:18.298754 18057 heartbeater.cc:503] Master 127.15.157.190:36191 was elected leader, sending a full tablet report...
W20260929 06:38:18.336563 18058 tablet.cc:2369] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:38:18.411022 18228 raft_consensus.cc:482] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:18.411144 18228 raft_consensus.cc:504] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.411453 18228 leader_election.cc:288] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d224ae95c2fb4233a22c9133798e3c38 (127.15.157.129:43037), 47a91ad02eb94d969eb6e9b33875a599 (127.15.157.131:35391)
I20260929 06:38:18.415352 18217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.411836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:54635 (local address 127.15.157.129:43037)
0929 06:38:18.411886 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.411888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.411993 (+ 105us) server_negotiation.cc:407] Connection header received
0929 06:38:18.412050 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.412050 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.412059 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.412105 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:18.412239 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.412942 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.414447 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.414998 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.415077 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.415085 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.415245 (+ 160us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.415282 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:38:18.415352 18216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.411753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:42127 (local address 127.15.157.131:35391)
0929 06:38:18.411802 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.411805 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.411819 (+ 14us) server_negotiation.cc:407] Connection header received
0929 06:38:18.411878 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.411879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.411889 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.412015 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:18.412163 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.412955 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.414443 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.414998 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.415077 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.415085 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.415245 (+ 160us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.415280 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 06:38:18.415378 17950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.411682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:35391 (local address 127.15.157.130:42127)
0929 06:38:18.411750 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.411764 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.411810 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.412022 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.412023 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.412025 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:18.412091 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.412093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.413029 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.413030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.414356 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.414358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.415081 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.415082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.415165 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.415169 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.415226 (+ 57us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.415272 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":45}
I20260929 06:38:18.415380 18229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.411682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:43037 (local address 127.15.157.130:54635)
0929 06:38:18.411920 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.411928 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.411994 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.412116 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.412117 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.412118 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:18.412173 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.412174 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.413029 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.413030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.414350 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.414355 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.415103 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.415104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.415169 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.415171 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.415226 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.415272 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":51,"thread_start_us":111,"threads_started":1}
I20260929 06:38:18.415779 18151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ff62ded080a4798af256e39297f7791" candidate_uuid: "77d69623f6454c198ca53ba2fbe5fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a91ad02eb94d969eb6e9b33875a599" is_pre_election: true
I20260929 06:38:18.415953 18151 raft_consensus.cc:2454] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77d69623f6454c198ca53ba2fbe5fc37 in term 0.
I20260929 06:38:18.415907 17871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ff62ded080a4798af256e39297f7791" candidate_uuid: "77d69623f6454c198ca53ba2fbe5fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d224ae95c2fb4233a22c9133798e3c38" is_pre_election: true
I20260929 06:38:18.416090 17871 raft_consensus.cc:2454] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77d69623f6454c198ca53ba2fbe5fc37 in term 0.
I20260929 06:38:18.416206 17943 leader_election.cc:302] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a91ad02eb94d969eb6e9b33875a599, 77d69623f6454c198ca53ba2fbe5fc37; no voters:
I20260929 06:38:18.416380 18228 raft_consensus.cc:2781] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:18.416441 18228 raft_consensus.cc:482] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:18.416468 18228 raft_consensus.cc:3037] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:18.417321 18228 raft_consensus.cc:504] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.417464 18228 leader_election.cc:288] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [CANDIDATE]: Term 1 election: Requested vote from peers d224ae95c2fb4233a22c9133798e3c38 (127.15.157.129:43037), 47a91ad02eb94d969eb6e9b33875a599 (127.15.157.131:35391)
I20260929 06:38:18.417583 17871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ff62ded080a4798af256e39297f7791" candidate_uuid: "77d69623f6454c198ca53ba2fbe5fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d224ae95c2fb4233a22c9133798e3c38"
I20260929 06:38:18.417599 18151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ff62ded080a4798af256e39297f7791" candidate_uuid: "77d69623f6454c198ca53ba2fbe5fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a91ad02eb94d969eb6e9b33875a599"
I20260929 06:38:18.417682 17871 raft_consensus.cc:3037] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:18.417677 18151 raft_consensus.cc:3037] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:18.418530 18151 raft_consensus.cc:2454] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d69623f6454c198ca53ba2fbe5fc37 in term 1.
I20260929 06:38:18.418532 17871 raft_consensus.cc:2454] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d69623f6454c198ca53ba2fbe5fc37 in term 1.
I20260929 06:38:18.418715 17945 leader_election.cc:302] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77d69623f6454c198ca53ba2fbe5fc37, d224ae95c2fb4233a22c9133798e3c38; no voters:
I20260929 06:38:18.418819 18228 raft_consensus.cc:2781] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:18.418964 18228 raft_consensus.cc:686] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 LEADER]: Becoming Leader. State: Replica: 77d69623f6454c198ca53ba2fbe5fc37, State: Running, Role: LEADER
I20260929 06:38:18.419072 18228 consensus_queue.cc:237] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.419916 17713 catalog_manager.cc:5495] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77d69623f6454c198ca53ba2fbe5fc37 (127.15.157.130). New cstate: current_term: 1 leader_uuid: "77d69623f6454c198ca53ba2fbe5fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } health_report { overall_health: UNKNOWN } } }
W20260929 06:38:18.433166 17918 tablet.cc:2369] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 29 06:38:18 dist-test-slave-ltw5 krb5kdc[17669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663897, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:18.457804 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.450863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44772 (local address 127.15.157.190:36191)
0929 06:38:18.450959 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.450962 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.451069 (+ 107us) server_negotiation.cc:407] Connection header received
0929 06:38:18.451180 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.451181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.451191 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.451263 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:18.451734 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.452225 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.452973 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.453154 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.453238 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.455224 (+ 1986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:18.455225 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:18.455226 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:18.455233 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:18.456573 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:18.456981 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:18.456982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:18.456982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:18.457038 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:18.457227 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:18.457228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:18.457229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:18.457360 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:18.457437 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.457587 (+ 150us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.457688 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260929 06:38:18.457881 18237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.450786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:36191 (local address 127.0.0.1:44772)
0929 06:38:18.450973 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.450985 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.451110 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.451266 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.451267 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.451596 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:18.451639 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.451641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.452318 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.452319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.452882 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.452884 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.453238 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.453239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.453291 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.453775 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:18.453779 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:18.455132 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:18.456683 (+ 1551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:18.456690 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:18.456693 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:18.456891 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:18.457102 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:18.457103 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:18.457103 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:18.457162 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:18.457428 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:18.457434 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:18.457480 (+ 46us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.457564 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.457753 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":84,"thread_start_us":108,"threads_started":1}
I20260929 06:38:18.460260 17713 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:44772:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260929 06:38:18.460536 17713 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:18.462059 17851 tablet_service.cc:1467] Processing CreateTablet for tablet c73594e57f13482ba8ef3067841b3272 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6d05c875893d42af92f3199de1f718db]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:38:18.462139 17991 tablet_service.cc:1467] Processing CreateTablet for tablet c73594e57f13482ba8ef3067841b3272 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6d05c875893d42af92f3199de1f718db]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:38:18.462128 18131 tablet_service.cc:1467] Processing CreateTablet for tablet c73594e57f13482ba8ef3067841b3272 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6d05c875893d42af92f3199de1f718db]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:38:18.462252 17851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c73594e57f13482ba8ef3067841b3272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:18.462268 17991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c73594e57f13482ba8ef3067841b3272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:18.462286 18131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c73594e57f13482ba8ef3067841b3272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:18.463438 18221 tablet_bootstrap.cc:492] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599: Bootstrap starting.
I20260929 06:38:18.463696 18220 tablet_bootstrap.cc:492] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38: Bootstrap starting.
I20260929 06:38:18.463698 18222 tablet_bootstrap.cc:492] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37: Bootstrap starting.
I20260929 06:38:18.463989 18220 tablet_bootstrap.cc:654] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:18.464047 18221 tablet_bootstrap.cc:654] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:18.464196 18222 tablet_bootstrap.cc:654] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:18.464635 18220 tablet_bootstrap.cc:492] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38: No bootstrap required, opened a new log
I20260929 06:38:18.464712 18220 ts_tablet_manager.cc:1397] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:18.464851 18220 raft_consensus.cc:348] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.464907 18221 tablet_bootstrap.cc:492] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599: No bootstrap required, opened a new log
I20260929 06:38:18.464947 18222 tablet_bootstrap.cc:492] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37: No bootstrap required, opened a new log
I20260929 06:38:18.464949 18220 raft_consensus.cc:374] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:18.464960 18221 ts_tablet_manager.cc:1397] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260929 06:38:18.464978 18220 raft_consensus.cc:729] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d224ae95c2fb4233a22c9133798e3c38, State: Initialized, Role: FOLLOWER
I20260929 06:38:18.464986 18222 ts_tablet_manager.cc:1397] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:18.465037 18220 consensus_queue.cc:260] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.465148 18220 ts_tablet_manager.cc:1428] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:18.465121 18222 raft_consensus.cc:348] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.465113 18221 raft_consensus.cc:348] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.465191 18221 raft_consensus.cc:374] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:18.465191 18222 raft_consensus.cc:374] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:18.465215 18222 raft_consensus.cc:729] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d69623f6454c198ca53ba2fbe5fc37, State: Initialized, Role: FOLLOWER
I20260929 06:38:18.465214 18221 raft_consensus.cc:729] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a91ad02eb94d969eb6e9b33875a599, State: Initialized, Role: FOLLOWER
I20260929 06:38:18.465263 18222 consensus_queue.cc:260] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.465263 18221 consensus_queue.cc:260] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.465292 18226 tablet_replica.cc:439] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } } }
I20260929 06:38:18.465355 18221 ts_tablet_manager.cc:1428] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:18.465365 18222 ts_tablet_manager.cc:1428] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:18.465375 18226 tablet_replica.cc:442] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:18.465483 18228 tablet_replica.cc:439] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } } }
I20260929 06:38:18.465569 18228 tablet_replica.cc:442] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:18.465693 18227 tablet_replica.cc:439] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } } }
I20260929 06:38:18.465793 18227 tablet_replica.cc:442] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599: This TxnStatusTablet replica's current role is: FOLLOWER
W20260929 06:38:18.493081 18198 tablet.cc:2369] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:38:18.633080 18228 raft_consensus.cc:482] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:18.633198 18228 raft_consensus.cc:504] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.633373 18228 leader_election.cc:288] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d224ae95c2fb4233a22c9133798e3c38 (127.15.157.129:43037), 47a91ad02eb94d969eb6e9b33875a599 (127.15.157.131:35391)
I20260929 06:38:18.633613 17871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c73594e57f13482ba8ef3067841b3272" candidate_uuid: "77d69623f6454c198ca53ba2fbe5fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d224ae95c2fb4233a22c9133798e3c38" is_pre_election: true
I20260929 06:38:18.633642 18151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c73594e57f13482ba8ef3067841b3272" candidate_uuid: "77d69623f6454c198ca53ba2fbe5fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a91ad02eb94d969eb6e9b33875a599" is_pre_election: true
I20260929 06:38:18.633704 17871 raft_consensus.cc:2454] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77d69623f6454c198ca53ba2fbe5fc37 in term 0.
I20260929 06:38:18.633739 18151 raft_consensus.cc:2454] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77d69623f6454c198ca53ba2fbe5fc37 in term 0.
I20260929 06:38:18.633860 17945 leader_election.cc:302] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77d69623f6454c198ca53ba2fbe5fc37, d224ae95c2fb4233a22c9133798e3c38; no voters:
I20260929 06:38:18.633965 18228 raft_consensus.cc:2781] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:18.634009 18228 raft_consensus.cc:482] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:18.634085 18228 raft_consensus.cc:3037] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:18.634743 18228 raft_consensus.cc:504] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.634904 18228 leader_election.cc:288] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [CANDIDATE]: Term 1 election: Requested vote from peers d224ae95c2fb4233a22c9133798e3c38 (127.15.157.129:43037), 47a91ad02eb94d969eb6e9b33875a599 (127.15.157.131:35391)
I20260929 06:38:18.635082 17871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c73594e57f13482ba8ef3067841b3272" candidate_uuid: "77d69623f6454c198ca53ba2fbe5fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d224ae95c2fb4233a22c9133798e3c38"
I20260929 06:38:18.635160 17871 raft_consensus.cc:3037] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:18.635142 18151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c73594e57f13482ba8ef3067841b3272" candidate_uuid: "77d69623f6454c198ca53ba2fbe5fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a91ad02eb94d969eb6e9b33875a599"
I20260929 06:38:18.635227 18151 raft_consensus.cc:3037] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:18.635885 18151 raft_consensus.cc:2454] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d69623f6454c198ca53ba2fbe5fc37 in term 1.
I20260929 06:38:18.635892 17871 raft_consensus.cc:2454] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d69623f6454c198ca53ba2fbe5fc37 in term 1.
I20260929 06:38:18.636045 17943 leader_election.cc:302] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a91ad02eb94d969eb6e9b33875a599, 77d69623f6454c198ca53ba2fbe5fc37; no voters:
I20260929 06:38:18.636137 18228 raft_consensus.cc:2781] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:18.636188 18228 raft_consensus.cc:686] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 LEADER]: Becoming Leader. State: Replica: 77d69623f6454c198ca53ba2fbe5fc37, State: Running, Role: LEADER
I20260929 06:38:18.636235 18228 consensus_queue.cc:237] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.636492 18230 tablet_replica.cc:439] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37: TxnStatusTablet state changed. Reason: New leader 77d69623f6454c198ca53ba2fbe5fc37. Latest consensus state: current_term: 1 leader_uuid: "77d69623f6454c198ca53ba2fbe5fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } } }
I20260929 06:38:18.636574 18230 tablet_replica.cc:442] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:38:18.636770 18242 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260929 06:38:18.636801 17713 catalog_manager.cc:5495] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77d69623f6454c198ca53ba2fbe5fc37 (127.15.157.130). New cstate: current_term: 1 leader_uuid: "77d69623f6454c198ca53ba2fbe5fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } health_report { overall_health: UNKNOWN } } }
I20260929 06:38:18.636916 18242 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260929 06:38:18.649303 18219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.646588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34052 (local address 127.15.157.130:35935)
0929 06:38:18.646631 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.646633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.646668 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:38:18.646761 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.646762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.646776 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.646829 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:18.646955 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.647436 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.648522 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.648698 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.648750 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.648966 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:18.649062 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:18.649138 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.649201 (+ 63us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.649221 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:38:18.649330 18237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.646536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:35935 (local address 127.0.0.1:34052)
0929 06:38:18.646625 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.646636 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.646686 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.646842 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.646843 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.646844 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:38:18.646895 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.646897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.647510 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.647511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.648440 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.648443 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.648768 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.648769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.648837 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.648853 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:38:18.649136 (+ 283us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:38:18.649143 (+ 7us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.649198 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.649244 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260929 06:38:18.651314 18151 raft_consensus.cc:1261] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Refusing update from remote peer 77d69623f6454c198ca53ba2fbe5fc37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:18.651623 17871 raft_consensus.cc:1261] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Refusing update from remote peer 77d69623f6454c198ca53ba2fbe5fc37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:18.651660 18230 consensus_queue.cc:1035] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:18.651861 18228 consensus_queue.cc:1035] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:18.653028 18226 tablet_replica.cc:439] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38: TxnStatusTablet state changed. Reason: New leader 77d69623f6454c198ca53ba2fbe5fc37. Latest consensus state: current_term: 1 leader_uuid: "77d69623f6454c198ca53ba2fbe5fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } } }
I20260929 06:38:18.653112 18226 tablet_replica.cc:442] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:18.653080 18227 tablet_replica.cc:439] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599: TxnStatusTablet state changed. Reason: New leader 77d69623f6454c198ca53ba2fbe5fc37. Latest consensus state: current_term: 1 leader_uuid: "77d69623f6454c198ca53ba2fbe5fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } } }
I20260929 06:38:18.653187 18227 tablet_replica.cc:442] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:18.654254 18228 tablet_replica.cc:439] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "77d69623f6454c198ca53ba2fbe5fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } } }
I20260929 06:38:18.654337 18228 tablet_replica.cc:442] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:38:18.654448 18227 tablet_replica.cc:439] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "77d69623f6454c198ca53ba2fbe5fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } } }
I20260929 06:38:18.654532 18227 tablet_replica.cc:442] T c73594e57f13482ba8ef3067841b3272 P 47a91ad02eb94d969eb6e9b33875a599: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:18.658744 18230 tablet_replica.cc:439] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "77d69623f6454c198ca53ba2fbe5fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } } }
I20260929 06:38:18.658842 18230 tablet_replica.cc:442] T c73594e57f13482ba8ef3067841b3272 P 77d69623f6454c198ca53ba2fbe5fc37: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:38:18.659119 18226 tablet_replica.cc:439] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "77d69623f6454c198ca53ba2fbe5fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } } }
I20260929 06:38:18.659204 18226 tablet_replica.cc:442] T c73594e57f13482ba8ef3067841b3272 P d224ae95c2fb4233a22c9133798e3c38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:18.659480 18219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.656640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34058 (local address 127.15.157.130:35935)
0929 06:38:18.656675 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.656677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.656727 (+ 50us) server_negotiation.cc:407] Connection header received
0929 06:38:18.656797 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.656798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.656806 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.656854 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:18.656976 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.657412 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.658492 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.658735 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.658803 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.659065 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:18.659100 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:18.659146 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.659382 (+ 236us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.659403 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 06:38:18.660027 18246 mvcc.cc:205] Tried to move back new op lower bound from 7334559328873177088 to 7334559328814346240. Current Snapshot: MvccSnapshot[applied={T|T < 7334559328873177088}]
I20260929 06:38:18.664777 18219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.662091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:35109 (local address 127.15.157.130:35935)
0929 06:38:18.662151 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.662153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.662298 (+ 145us) server_negotiation.cc:407] Connection header received
0929 06:38:18.662369 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.662369 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.662384 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.662451 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:18.662879 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.663304 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.664084 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.664260 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.664342 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.664527 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:18.664562 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:18.664623 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.664681 (+ 58us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.664696 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 06:38:18.664839 18256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.662061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:35935 (local address 127.15.157.130:35109)
0929 06:38:18.662223 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.662233 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.662314 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.662454 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.662455 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.662456 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:38:18.662783 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.662785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.663383 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.663384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.663986 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.663988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.664341 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.664342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.664415 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.664427 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:38:18.664622 (+ 195us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:38:18.664623 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.664676 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.664714 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":111,"threads_started":1}
I20260929 06:38:18.667047 18151 raft_consensus.cc:1261] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Refusing update from remote peer 77d69623f6454c198ca53ba2fbe5fc37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:18.667047 17871 raft_consensus.cc:1261] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Refusing update from remote peer 77d69623f6454c198ca53ba2fbe5fc37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:18.667254 18258 consensus_queue.cc:1035] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:18.667510 18228 consensus_queue.cc:1035] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:18.668723 18245 mvcc.cc:205] Tried to move back new op lower bound from 7334559328938242048 to 7334559327925153792. Current Snapshot: MvccSnapshot[applied={T|T < 7334559328938242048}]
I20260929 06:38:18.678699 17713 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:18.678797 17713 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:18.679567 17713 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7: Sending DeleteTablet for 3 replicas of tablet 8ff62ded080a4798af256e39297f7791
I20260929 06:38:18.679872 17851 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ff62ded080a4798af256e39297f7791 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:18 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:44608
I20260929 06:38:18.679899 18131 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ff62ded080a4798af256e39297f7791 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:18 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:48642
I20260929 06:38:18.679906 17991 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ff62ded080a4798af256e39297f7791 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:18 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:34036
I20260929 06:38:18.680125 18264 tablet_replica.cc:330] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: stopping tablet replica
I20260929 06:38:18.680127 18262 tablet_replica.cc:330] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38: stopping tablet replica
I20260929 06:38:18.680227 18262 raft_consensus.cc:2229] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:18.680227 18264 raft_consensus.cc:2229] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:18.680163 17713 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44758:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260929 06:38:18.680276 18264 pending_rounds.cc:62] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: Trying to abort 2 pending ops.
W20260929 06:38:18.680298 17713 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:18.680311 18262 raft_consensus.cc:2258] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:18.680294 18264 pending_rounds.cc:68] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7334559328938242048 op_type: PARTICIPANT_OP participant_request { tablet_id: "8ff62ded080a4798af256e39297f7791" op { type: BEGIN_TXN txn_id: 0 } }
W20260929 06:38:18.680337 18260 consensus_queue.cc:1159] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "47a91ad02eb94d969eb6e9b33875a599" status { last_received { term: 1 index: 2 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 2 } }
I20260929 06:38:18.680406 18264 pending_rounds.cc:68] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334559327925153792 op_type: NO_OP noop_request { }
I20260929 06:38:18.680516 18263 tablet_replica.cc:330] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37: stopping tablet replica
I20260929 06:38:18.680526 18264 raft_consensus.cc:2866] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260929 06:38:18.680570 18264 raft_consensus.cc:2258] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:18.680608 18263 raft_consensus.cc:2229] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:38:18.680722 18263 raft_consensus.cc:2258] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:18.680991 18262 ts_tablet_manager.cc:1905] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:18.680999 18264 ts_tablet_manager.cc:1905] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:18.681057 18263 ts_tablet_manager.cc:1905] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:18.681926 17851 tablet_service.cc:1467] Processing CreateTablet for tablet e45ef22ea9be400f9e0b335d4149f279 (DEFAULT_TABLE table=test-table [id=1dbaf7dc79a943b39019157283e8b652]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:18.682055 17851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e45ef22ea9be400f9e0b335d4149f279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:18.682724 17991 tablet_service.cc:1467] Processing CreateTablet for tablet e45ef22ea9be400f9e0b335d4149f279 (DEFAULT_TABLE table=test-table [id=1dbaf7dc79a943b39019157283e8b652]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:18.682893 18131 tablet_service.cc:1467] Processing CreateTablet for tablet e45ef22ea9be400f9e0b335d4149f279 (DEFAULT_TABLE table=test-table [id=1dbaf7dc79a943b39019157283e8b652]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:18.682987 18264 ts_tablet_manager.cc:1918] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:18.683061 18264 log.cc:1196] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/8ff62ded080a4798af256e39297f7791
I20260929 06:38:18.682993 18131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e45ef22ea9be400f9e0b335d4149f279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:18.683326 18264 ts_tablet_manager.cc:1939] T 8ff62ded080a4798af256e39297f7791 P 47a91ad02eb94d969eb6e9b33875a599: Deleting consensus metadata
I20260929 06:38:18.683694 18220 tablet_bootstrap.cc:492] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38: Bootstrap starting.
I20260929 06:38:18.683933 18263 ts_tablet_manager.cc:1918] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:38:18.683996 18263 log.cc:1196] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/8ff62ded080a4798af256e39297f7791
I20260929 06:38:18.684175 18220 tablet_bootstrap.cc:654] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:18.684276 18221 tablet_bootstrap.cc:492] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599: Bootstrap starting.
I20260929 06:38:18.684281 18263 ts_tablet_manager.cc:1939] T 8ff62ded080a4798af256e39297f7791 P 77d69623f6454c198ca53ba2fbe5fc37: Deleting consensus metadata
I20260929 06:38:18.684448 18262 ts_tablet_manager.cc:1918] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:38:18.684504 18262 log.cc:1196] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/wal/wals/8ff62ded080a4798af256e39297f7791
I20260929 06:38:18.684643 18221 tablet_bootstrap.cc:654] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:18.684733 18220 tablet_bootstrap.cc:492] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38: No bootstrap required, opened a new log
I20260929 06:38:18.684741 18262 ts_tablet_manager.cc:1939] T 8ff62ded080a4798af256e39297f7791 P d224ae95c2fb4233a22c9133798e3c38: Deleting consensus metadata
I20260929 06:38:18.684787 18220 ts_tablet_manager.cc:1397] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:18.684930 18220 raft_consensus.cc:348] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.684990 18220 raft_consensus.cc:374] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:18.685009 18220 raft_consensus.cc:729] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d224ae95c2fb4233a22c9133798e3c38, State: Initialized, Role: FOLLOWER
I20260929 06:38:18.685005 17699 catalog_manager.cc:4841] TS 47a91ad02eb94d969eb6e9b33875a599 (127.15.157.131:35391): tablet 8ff62ded080a4798af256e39297f7791 (table test-table [id=0f43caa4a3c74aada36e0cdb45b6f776]) successfully deleted
I20260929 06:38:18.685057 18220 consensus_queue.cc:260] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.685128 17701 catalog_manager.cc:4841] TS d224ae95c2fb4233a22c9133798e3c38 (127.15.157.129:43037): tablet 8ff62ded080a4798af256e39297f7791 (table test-table [id=0f43caa4a3c74aada36e0cdb45b6f776]) successfully deleted
I20260929 06:38:18.685155 18220 ts_tablet_manager.cc:1428] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:18.685213 17991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e45ef22ea9be400f9e0b335d4149f279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:18.686141 17701 catalog_manager.cc:4841] TS 77d69623f6454c198ca53ba2fbe5fc37 (127.15.157.130:35935): tablet 8ff62ded080a4798af256e39297f7791 (table test-table [id=0f43caa4a3c74aada36e0cdb45b6f776]) successfully deleted
I20260929 06:38:18.686388 18222 tablet_bootstrap.cc:492] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37: Bootstrap starting.
I20260929 06:38:18.686772 18222 tablet_bootstrap.cc:654] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:18.686903 18221 tablet_bootstrap.cc:492] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599: No bootstrap required, opened a new log
I20260929 06:38:18.686975 18221 ts_tablet_manager.cc:1397] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20260929 06:38:18.687117 18221 raft_consensus.cc:348] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.687187 18221 raft_consensus.cc:374] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:18.687215 18221 raft_consensus.cc:729] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a91ad02eb94d969eb6e9b33875a599, State: Initialized, Role: FOLLOWER
I20260929 06:38:18.687254 18221 consensus_queue.cc:260] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.687348 18221 ts_tablet_manager.cc:1428] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:18.687440 18222 tablet_bootstrap.cc:492] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37: No bootstrap required, opened a new log
I20260929 06:38:18.687479 18222 ts_tablet_manager.cc:1397] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:18.687633 18222 raft_consensus.cc:348] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.687700 18222 raft_consensus.cc:374] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:18.687721 18222 raft_consensus.cc:729] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d69623f6454c198ca53ba2fbe5fc37, State: Initialized, Role: FOLLOWER
I20260929 06:38:18.687763 18222 consensus_queue.cc:260] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.687852 18222 ts_tablet_manager.cc:1428] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:18.762786 18227 raft_consensus.cc:482] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:18.762903 18227 raft_consensus.cc:504] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.763233 18227 leader_election.cc:288] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d224ae95c2fb4233a22c9133798e3c38 (127.15.157.129:43037), 77d69623f6454c198ca53ba2fbe5fc37 (127.15.157.130:35935)
I20260929 06:38:18.766757 18269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.763661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:35935 (local address 127.15.157.131:37049)
0929 06:38:18.763739 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.763747 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.763784 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.764081 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.764082 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.764084 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:18.764148 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.764150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.764975 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.764976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.765732 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.765734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.766463 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.766464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.766546 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.766551 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.766622 (+ 71us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.766668 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69,"mutex_wait_us":1,"thread_start_us":36,"threads_started":1}
I20260929 06:38:18.766752 18219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.763879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:37049 (local address 127.15.157.130:35935)
0929 06:38:18.763937 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.763939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.763947 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:18.763971 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.763972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.763980 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.764033 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:18.764235 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.764897 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.765831 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.766376 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.766449 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.766459 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.766637 (+ 178us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.766673 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 06:38:18.767129 18217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.763534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:35941 (local address 127.15.157.129:43037)
0929 06:38:18.763587 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.763589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.763701 (+ 112us) server_negotiation.cc:407] Connection header received
0929 06:38:18.763732 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.763733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.763743 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.763815 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:18.764003 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.764752 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.766126 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.766655 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.766717 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.766724 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.767012 (+ 288us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.767056 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 06:38:18.767392 18268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.763457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:43037 (local address 127.15.157.131:35941)
0929 06:38:18.763591 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.763603 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.763667 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.763829 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.763830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.763831 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:18.763915 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.763917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.764856 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.764857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.766040 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.766042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.766756 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.766757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.766926 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.766931 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.767213 (+ 282us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.767268 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":88,"threads_started":1}
I20260929 06:38:18.767444 18011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e45ef22ea9be400f9e0b335d4149f279" candidate_uuid: "47a91ad02eb94d969eb6e9b33875a599" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d69623f6454c198ca53ba2fbe5fc37" is_pre_election: true
I20260929 06:38:18.767581 18011 raft_consensus.cc:2454] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47a91ad02eb94d969eb6e9b33875a599 in term 0.
I20260929 06:38:18.767750 17871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e45ef22ea9be400f9e0b335d4149f279" candidate_uuid: "47a91ad02eb94d969eb6e9b33875a599" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d224ae95c2fb4233a22c9133798e3c38" is_pre_election: true
I20260929 06:38:18.767752 18085 leader_election.cc:302] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a91ad02eb94d969eb6e9b33875a599, 77d69623f6454c198ca53ba2fbe5fc37; no voters:
I20260929 06:38:18.767833 17871 raft_consensus.cc:2454] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47a91ad02eb94d969eb6e9b33875a599 in term 0.
I20260929 06:38:18.767911 18227 raft_consensus.cc:2781] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:18.767953 18227 raft_consensus.cc:482] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:18.767983 18227 raft_consensus.cc:3037] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:18.768651 18227 raft_consensus.cc:504] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.768796 18227 leader_election.cc:288] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [CANDIDATE]: Term 1 election: Requested vote from peers d224ae95c2fb4233a22c9133798e3c38 (127.15.157.129:43037), 77d69623f6454c198ca53ba2fbe5fc37 (127.15.157.130:35935)
I20260929 06:38:18.768966 17871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e45ef22ea9be400f9e0b335d4149f279" candidate_uuid: "47a91ad02eb94d969eb6e9b33875a599" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d224ae95c2fb4233a22c9133798e3c38"
I20260929 06:38:18.769043 17871 raft_consensus.cc:3037] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:18.769760 17871 raft_consensus.cc:2454] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47a91ad02eb94d969eb6e9b33875a599 in term 1.
I20260929 06:38:18.769922 18011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e45ef22ea9be400f9e0b335d4149f279" candidate_uuid: "47a91ad02eb94d969eb6e9b33875a599" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d69623f6454c198ca53ba2fbe5fc37"
I20260929 06:38:18.769996 18011 raft_consensus.cc:3037] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:18.770824 18011 raft_consensus.cc:2454] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47a91ad02eb94d969eb6e9b33875a599 in term 1.
I20260929 06:38:18.770928 18085 leader_election.cc:302] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a91ad02eb94d969eb6e9b33875a599, d224ae95c2fb4233a22c9133798e3c38; no voters:
I20260929 06:38:18.771032 18227 raft_consensus.cc:2781] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:18.771180 18227 raft_consensus.cc:686] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 LEADER]: Becoming Leader. State: Replica: 47a91ad02eb94d969eb6e9b33875a599, State: Running, Role: LEADER
I20260929 06:38:18.771276 18227 consensus_queue.cc:237] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:18.771984 17714 catalog_manager.cc:5495] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47a91ad02eb94d969eb6e9b33875a599 (127.15.157.131). New cstate: current_term: 1 leader_uuid: "47a91ad02eb94d969eb6e9b33875a599" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } health_report { overall_health: HEALTHY } } }
I20260929 06:38:18.784973 18216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.782588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48648 (local address 127.15.157.131:35391)
0929 06:38:18.782625 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.782627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.782636 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:18.782706 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.782707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.782724 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.782784 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:18.782923 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.783398 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.784294 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.784473 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.784521 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.784669 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:18.784765 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:18.784824 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.784878 (+ 54us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.784895 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:38:18.790266 18274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.787531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:35935 (local address 127.15.157.131:59141)
0929 06:38:18.787664 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.787674 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.787753 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.787910 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.787911 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.787912 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:38:18.787975 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.787976 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.788621 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.788622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.789323 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.789325 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.789754 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.789755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.789816 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.789836 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:38:18.790088 (+ 252us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:38:18.790090 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.790144 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.790183 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":78,"threads_started":1}
I20260929 06:38:18.790238 18219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.787671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:59141 (local address 127.15.157.130:35935)
0929 06:38:18.787742 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.787744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.787753 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:18.787807 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.787808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.787819 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.787906 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:18.788059 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.788510 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.789464 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.789685 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.789754 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.789938 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:18.789977 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:18.790085 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.790149 (+ 64us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.790164 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260929 06:38:18.792507 17871 raft_consensus.cc:1261] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Refusing update from remote peer 47a91ad02eb94d969eb6e9b33875a599: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:18.792575 18011 raft_consensus.cc:1261] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Refusing update from remote peer 47a91ad02eb94d969eb6e9b33875a599: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:18.792774 18270 consensus_queue.cc:1035] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:18.792878 18227 consensus_queue.cc:1035] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:18.800940 18216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.798154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:52825 (local address 127.15.157.131:35391)
0929 06:38:18.798186 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:18.798188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:18.798254 (+ 66us) server_negotiation.cc:407] Connection header received
0929 06:38:18.798331 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:18.798331 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:18.798339 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:18.798396 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:18.798522 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.799141 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.800169 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.800450 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.800510 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.800713 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:18.800744 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:18.800797 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:18.800855 (+ 58us) server_negotiation.cc:299] Negotiation successful
0929 06:38:18.800872 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260929 06:38:18.800956 18256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:18.798106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:35391 (local address 127.15.157.130:52825)
0929 06:38:18.798194 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:18.798205 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:18.798267 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:18.798412 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:18.798414 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:18.798416 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:38:18.798453 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.798454 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.799208 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.799209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.800090 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:18.800092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:18.800598 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:18.800599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:18.800639 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:18.800644 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:38:18.800799 (+ 155us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:38:18.800801 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:38:18.800847 (+ 46us) client_negotiation.cc:240] Negotiation successful
0929 06:38:18.800891 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
W20260929 06:38:18.801479 18247 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260929 06:38:20.324995 17713 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:20.325095 17713 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:20.325860 17713 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7: Sending DeleteTablet for 3 replicas of tablet e45ef22ea9be400f9e0b335d4149f279
I20260929 06:38:20.326186 18131 tablet_service.cc:1514] Processing DeleteTablet for tablet e45ef22ea9be400f9e0b335d4149f279 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:20 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:48642
I20260929 06:38:20.326205 17851 tablet_service.cc:1514] Processing DeleteTablet for tablet e45ef22ea9be400f9e0b335d4149f279 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:20 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:44608
I20260929 06:38:20.326285 17991 tablet_service.cc:1514] Processing DeleteTablet for tablet e45ef22ea9be400f9e0b335d4149f279 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:20 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:34036
I20260929 06:38:20.326490 18302 tablet_replica.cc:330] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37: stopping tablet replica
I20260929 06:38:20.326555 18302 raft_consensus.cc:2229] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:20.326598 18302 raft_consensus.cc:2258] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:20.326776 18300 tablet_replica.cc:330] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599: stopping tablet replica
I20260929 06:38:20.326808 18302 ts_tablet_manager.cc:1905] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:20.326838 18300 raft_consensus.cc:2229] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:38:20.326933 18300 raft_consensus.cc:2258] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:20.327179 18300 ts_tablet_manager.cc:1905] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:20.328485 18302 ts_tablet_manager.cc:1918] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 06:38:20.328558 18302 log.cc:1196] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/e45ef22ea9be400f9e0b335d4149f279
I20260929 06:38:20.328791 18302 ts_tablet_manager.cc:1939] T e45ef22ea9be400f9e0b335d4149f279 P 77d69623f6454c198ca53ba2fbe5fc37: Deleting consensus metadata
I20260929 06:38:20.329102 17701 catalog_manager.cc:4841] TS 77d69623f6454c198ca53ba2fbe5fc37 (127.15.157.130:35935): tablet e45ef22ea9be400f9e0b335d4149f279 (table test-table [id=1dbaf7dc79a943b39019157283e8b652]) successfully deleted
I20260929 06:38:20.329283 18300 ts_tablet_manager.cc:1918] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 06:38:20.329350 18300 log.cc:1196] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/e45ef22ea9be400f9e0b335d4149f279
I20260929 06:38:20.329612 18300 ts_tablet_manager.cc:1939] T e45ef22ea9be400f9e0b335d4149f279 P 47a91ad02eb94d969eb6e9b33875a599: Deleting consensus metadata
I20260929 06:38:20.329780 18301 tablet_replica.cc:330] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38: stopping tablet replica
I20260929 06:38:20.329854 18301 raft_consensus.cc:2229] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:20.329942 18301 raft_consensus.cc:2258] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:20.330008 17699 catalog_manager.cc:4841] TS 47a91ad02eb94d969eb6e9b33875a599 (127.15.157.131:35391): tablet e45ef22ea9be400f9e0b335d4149f279 (table test-table [id=1dbaf7dc79a943b39019157283e8b652]) successfully deleted
I20260929 06:38:20.330251 18301 ts_tablet_manager.cc:1905] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:20.332154 18301 ts_tablet_manager.cc:1918] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 06:38:20.332221 18301 log.cc:1196] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/wal/wals/e45ef22ea9be400f9e0b335d4149f279
I20260929 06:38:20.332468 18301 ts_tablet_manager.cc:1939] T e45ef22ea9be400f9e0b335d4149f279 P d224ae95c2fb4233a22c9133798e3c38: Deleting consensus metadata
I20260929 06:38:20.332854 17701 catalog_manager.cc:4841] TS d224ae95c2fb4233a22c9133798e3c38 (127.15.157.129:43037): tablet e45ef22ea9be400f9e0b335d4149f279 (table test-table [id=1dbaf7dc79a943b39019157283e8b652]) successfully deleted
Sep 29 06:38:20 dist-test-slave-ltw5 krb5kdc[17669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663900, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 06:38:20 dist-test-slave-ltw5 krb5kdc[17669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663900, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:20.358526 18310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:20.344671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44786 (local address 127.15.157.190:36191)
0929 06:38:20.344820 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:20.344822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:20.344830 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:20.344855 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:20.344855 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:20.344866 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:20.344972 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:20.345548 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.346118 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.346827 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.347030 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.347112 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:20.355789 (+ 8677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:20.355791 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:20.355791 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:20.355799 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:20.357407 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:20.357738 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:20.357739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:20.357740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:20.357815 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:20.357998 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:20.357998 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:20.357998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:20.358179 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:20.358261 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:20.358370 (+ 109us) server_negotiation.cc:299] Negotiation successful
0929 06:38:20.358442 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
I20260929 06:38:20.360117 17713 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:38:20.360284 17713 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:20.361552 17991 tablet_service.cc:1467] Processing CreateTablet for tablet c0433e5807bd45acaeb0f25907755c4d (DEFAULT_TABLE table=test-table [id=3434060b16ee4e9d8e2272e92a10f6f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:20.361553 17851 tablet_service.cc:1467] Processing CreateTablet for tablet c0433e5807bd45acaeb0f25907755c4d (DEFAULT_TABLE table=test-table [id=3434060b16ee4e9d8e2272e92a10f6f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:20.361588 18131 tablet_service.cc:1467] Processing CreateTablet for tablet c0433e5807bd45acaeb0f25907755c4d (DEFAULT_TABLE table=test-table [id=3434060b16ee4e9d8e2272e92a10f6f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:20.361688 17991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0433e5807bd45acaeb0f25907755c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:20.361688 17851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0433e5807bd45acaeb0f25907755c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:20.361734 18131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0433e5807bd45acaeb0f25907755c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:20.362888 18311 tablet_bootstrap.cc:492] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599: Bootstrap starting.
I20260929 06:38:20.363191 18313 tablet_bootstrap.cc:492] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38: Bootstrap starting.
I20260929 06:38:20.363323 18311 tablet_bootstrap.cc:654] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:20.363647 18313 tablet_bootstrap.cc:654] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:20.363933 18312 tablet_bootstrap.cc:492] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37: Bootstrap starting.
I20260929 06:38:20.363934 18311 tablet_bootstrap.cc:492] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599: No bootstrap required, opened a new log
I20260929 06:38:20.364004 18311 ts_tablet_manager.cc:1397] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:20.364198 18313 tablet_bootstrap.cc:492] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38: No bootstrap required, opened a new log
I20260929 06:38:20.364253 18313 ts_tablet_manager.cc:1397] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:20.364192 18311 raft_consensus.cc:348] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.364287 18311 raft_consensus.cc:374] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:20.364295 18312 tablet_bootstrap.cc:654] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:20.364346 18311 raft_consensus.cc:729] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a91ad02eb94d969eb6e9b33875a599, State: Initialized, Role: FOLLOWER
I20260929 06:38:20.364420 18311 consensus_queue.cc:260] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.364406 18313 raft_consensus.cc:348] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.364470 18313 raft_consensus.cc:374] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:20.364516 18313 raft_consensus.cc:729] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d224ae95c2fb4233a22c9133798e3c38, State: Initialized, Role: FOLLOWER
I20260929 06:38:20.364573 18313 consensus_queue.cc:260] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.364693 18311 ts_tablet_manager.cc:1428] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260929 06:38:20.364763 18313 ts_tablet_manager.cc:1428] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:20.364943 18312 tablet_bootstrap.cc:492] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37: No bootstrap required, opened a new log
I20260929 06:38:20.364989 18312 ts_tablet_manager.cc:1397] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:20.365091 18312 raft_consensus.cc:348] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.365152 18312 raft_consensus.cc:374] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:20.365170 18312 raft_consensus.cc:729] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d69623f6454c198ca53ba2fbe5fc37, State: Initialized, Role: FOLLOWER
I20260929 06:38:20.365212 18312 consensus_queue.cc:260] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.365315 18312 ts_tablet_manager.cc:1428] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:20.526424 18317 raft_consensus.cc:482] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:20.526521 18317 raft_consensus.cc:504] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.526923 18317 leader_election.cc:288] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77d69623f6454c198ca53ba2fbe5fc37 (127.15.157.130:35935), 47a91ad02eb94d969eb6e9b33875a599 (127.15.157.131:35391)
I20260929 06:38:20.529953 18321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:20.527191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:38881 (local address 127.15.157.130:35935)
0929 06:38:20.527322 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:20.527325 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:20.527402 (+ 77us) server_negotiation.cc:407] Connection header received
0929 06:38:20.527490 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:20.527491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:20.527501 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:20.527576 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:20.527729 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.528219 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.529218 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.529588 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.529681 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:20.529691 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:20.529826 (+ 135us) server_negotiation.cc:299] Negotiation successful
0929 06:38:20.529867 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":73,"threads_started":1}
I20260929 06:38:20.530062 18319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:20.527135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:35391 (local address 127.15.157.129:42583)
0929 06:38:20.527338 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:20.527348 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:20.527435 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:20.527601 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:20.527602 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:20.527604 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:20.527675 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:20.527677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.528311 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.528312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:20.529135 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:20.529138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.529709 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.529710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:20.529786 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:20.529796 (+ 10us) client_negotiation.cc:769] Sending connection context
0929 06:38:20.529906 (+ 110us) client_negotiation.cc:240] Negotiation successful
0929 06:38:20.529949 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":36,"thread_start_us":129,"threads_started":1}
I20260929 06:38:20.530045 18320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:20.527168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:42583 (local address 127.15.157.131:35391)
0929 06:38:20.527327 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:20.527330 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:20.527417 (+ 87us) server_negotiation.cc:407] Connection header received
0929 06:38:20.527508 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:20.527509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:20.527525 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:20.527598 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:20.527754 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.528226 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.529240 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.529610 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.529689 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:20.529697 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:20.529916 (+ 219us) server_negotiation.cc:299] Negotiation successful
0929 06:38:20.529957 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":94,"threads_started":1}
I20260929 06:38:20.530186 18318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:20.527126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:35935 (local address 127.15.157.129:38881)
0929 06:38:20.527318 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:20.527330 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:20.527416 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:20.527579 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:20.527580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:20.527582 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:20.527658 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:20.527660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.528302 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.528304 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:20.529124 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:20.529126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.529681 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.529682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:20.529757 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:20.529761 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:38:20.529822 (+ 61us) client_negotiation.cc:240] Negotiation successful
0929 06:38:20.529864 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":1,"thread_start_us":128,"threads_started":1}
I20260929 06:38:20.530277 18151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0433e5807bd45acaeb0f25907755c4d" candidate_uuid: "d224ae95c2fb4233a22c9133798e3c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a91ad02eb94d969eb6e9b33875a599" is_pre_election: true
I20260929 06:38:20.530380 18151 raft_consensus.cc:2454] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d224ae95c2fb4233a22c9133798e3c38 in term 0.
I20260929 06:38:20.530572 17803 leader_election.cc:302] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a91ad02eb94d969eb6e9b33875a599, d224ae95c2fb4233a22c9133798e3c38; no voters:
I20260929 06:38:20.530618 18011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0433e5807bd45acaeb0f25907755c4d" candidate_uuid: "d224ae95c2fb4233a22c9133798e3c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d69623f6454c198ca53ba2fbe5fc37" is_pre_election: true
I20260929 06:38:20.530678 18011 raft_consensus.cc:2454] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d224ae95c2fb4233a22c9133798e3c38 in term 0.
I20260929 06:38:20.530778 18317 raft_consensus.cc:2781] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:20.530823 18317 raft_consensus.cc:482] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:20.530848 18317 raft_consensus.cc:3037] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:20.531530 18317 raft_consensus.cc:504] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.531677 18317 leader_election.cc:288] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [CANDIDATE]: Term 1 election: Requested vote from peers 77d69623f6454c198ca53ba2fbe5fc37 (127.15.157.130:35935), 47a91ad02eb94d969eb6e9b33875a599 (127.15.157.131:35391)
I20260929 06:38:20.531917 18151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0433e5807bd45acaeb0f25907755c4d" candidate_uuid: "d224ae95c2fb4233a22c9133798e3c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a91ad02eb94d969eb6e9b33875a599"
I20260929 06:38:20.531931 18011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0433e5807bd45acaeb0f25907755c4d" candidate_uuid: "d224ae95c2fb4233a22c9133798e3c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d69623f6454c198ca53ba2fbe5fc37"
I20260929 06:38:20.531993 18151 raft_consensus.cc:3037] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:20.532012 18011 raft_consensus.cc:3037] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:20.532570 18151 raft_consensus.cc:2454] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d224ae95c2fb4233a22c9133798e3c38 in term 1.
I20260929 06:38:20.532630 18011 raft_consensus.cc:2454] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d224ae95c2fb4233a22c9133798e3c38 in term 1.
I20260929 06:38:20.532754 17803 leader_election.cc:302] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a91ad02eb94d969eb6e9b33875a599, d224ae95c2fb4233a22c9133798e3c38; no voters:
I20260929 06:38:20.532855 18317 raft_consensus.cc:2781] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:20.532991 18317 raft_consensus.cc:686] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [term 1 LEADER]: Becoming Leader. State: Replica: d224ae95c2fb4233a22c9133798e3c38, State: Running, Role: LEADER
I20260929 06:38:20.533063 18317 consensus_queue.cc:237] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.533814 17714 catalog_manager.cc:5495] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 reported cstate change: term changed from 0 to 1, leader changed from <none> to d224ae95c2fb4233a22c9133798e3c38 (127.15.157.129). New cstate: current_term: 1 leader_uuid: "d224ae95c2fb4233a22c9133798e3c38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } health_report { overall_health: UNKNOWN } } }
I20260929 06:38:20.549705 18325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:20.546923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44618 (local address 127.15.157.129:43037)
0929 06:38:20.547078 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:20.547080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:20.547087 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:20.547131 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:20.547131 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:20.547150 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:20.547236 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:20.547343 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.548040 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.548856 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.549106 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.549180 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:20.549324 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:20.549447 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:20.549524 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:20.549581 (+ 57us) server_negotiation.cc:299] Negotiation successful
0929 06:38:20.549602 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":85,"threads_started":1}
I20260929 06:38:20.554528 18321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:20.552366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:50301 (local address 127.15.157.130:35935)
0929 06:38:20.552425 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:20.552427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:20.552451 (+ 24us) server_negotiation.cc:407] Connection header received
0929 06:38:20.552515 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:20.552515 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:20.552523 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:20.552571 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:20.552722 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.553187 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.553937 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.554161 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.554212 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:20.554355 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:20.554380 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:20.554421 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:20.554454 (+ 33us) server_negotiation.cc:299] Negotiation successful
0929 06:38:20.554471 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 06:38:20.554545 18328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:20.552192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:35935 (local address 127.15.157.129:50301)
0929 06:38:20.552393 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:20.552405 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:20.552471 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:20.552604 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:20.552605 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:20.552607 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:38:20.552660 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:20.552661 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.553252 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.553252 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:20.553848 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:20.553850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.554228 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.554229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:20.554280 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:20.554293 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:38:20.554421 (+ 128us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:38:20.554422 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 06:38:20.554452 (+ 30us) client_negotiation.cc:240] Negotiation successful
0929 06:38:20.554484 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":86,"threads_started":1}
I20260929 06:38:20.556771 18011 raft_consensus.cc:1261] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Refusing update from remote peer d224ae95c2fb4233a22c9133798e3c38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:20.556793 18151 raft_consensus.cc:1261] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Refusing update from remote peer d224ae95c2fb4233a22c9133798e3c38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:20.557041 18317 consensus_queue.cc:1035] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:20.557199 18322 consensus_queue.cc:1035] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:20.558652 18282 mvcc.cc:205] Tried to move back new op lower bound from 7334559336678875136 to 7334559336584134656. Current Snapshot: MvccSnapshot[applied={T|T < 7334559336678875136}]
I20260929 06:38:20.564291 18325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:20.561982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:60577 (local address 127.15.157.129:43037)
0929 06:38:20.562043 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:20.562045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:20.562103 (+ 58us) server_negotiation.cc:407] Connection header received
0929 06:38:20.562180 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:20.562180 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:20.562188 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:20.562230 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:20.562306 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.562757 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.563564 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.563858 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.563922 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:20.564096 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:20.564129 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:20.564178 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:20.564221 (+ 43us) server_negotiation.cc:299] Negotiation successful
0929 06:38:20.564239 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:38:20.564307 18333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:20.561890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:43037 (local address 127.15.157.130:60577)
0929 06:38:20.562046 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:20.562058 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:20.562113 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:20.562232 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:20.562232 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:20.562234 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:38:20.562271 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:20.562272 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.562856 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.562857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:20.563429 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:20.563431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.563926 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.563927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:20.564002 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:20.564008 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:38:20.564180 (+ 172us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:38:20.564181 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 06:38:20.564213 (+ 32us) client_negotiation.cc:240] Negotiation successful
0929 06:38:20.564249 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":78,"threads_started":1}
I20260929 06:38:20.570439 17713 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:20.570552 17713 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:20.571147 17713 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7: Sending DeleteTablet for 3 replicas of tablet c0433e5807bd45acaeb0f25907755c4d
I20260929 06:38:20.571412 18131 tablet_service.cc:1514] Processing DeleteTablet for tablet c0433e5807bd45acaeb0f25907755c4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:20 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:48642
I20260929 06:38:20.571425 17851 tablet_service.cc:1514] Processing DeleteTablet for tablet c0433e5807bd45acaeb0f25907755c4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:20 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:44608
I20260929 06:38:20.571501 18300 tablet_replica.cc:330] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599: stopping tablet replica
I20260929 06:38:20.571512 17991 tablet_service.cc:1514] Processing DeleteTablet for tablet c0433e5807bd45acaeb0f25907755c4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:20 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:34036
I20260929 06:38:20.571513 18301 tablet_replica.cc:330] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38: stopping tablet replica
I20260929 06:38:20.571543 18300 raft_consensus.cc:2229] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:20.571575 18301 raft_consensus.cc:2229] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:38:20.571581 18300 raft_consensus.cc:2258] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:20.571579 18302 tablet_replica.cc:330] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37: stopping tablet replica
I20260929 06:38:20.571628 18302 raft_consensus.cc:2229] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:20.571650 18301 raft_consensus.cc:2258] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:20.571664 18302 raft_consensus.cc:2258] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:20.572009 18300 ts_tablet_manager.cc:1905] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:20.571979 17713 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:38:20.572104 17713 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:20.572428 18302 ts_tablet_manager.cc:1905] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:20.573204 18131 tablet_service.cc:1467] Processing CreateTablet for tablet d588fef16209443aa3ae303591835904 (DEFAULT_TABLE table=test-table [id=116551db2f334b5081ba924c89369082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:20.573313 18131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d588fef16209443aa3ae303591835904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:20.574002 18302 ts_tablet_manager.cc:1918] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:38:20.574055 18301 ts_tablet_manager.cc:1905] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:20.574085 18302 log.cc:1196] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/c0433e5807bd45acaeb0f25907755c4d
I20260929 06:38:20.574299 18302 ts_tablet_manager.cc:1939] T c0433e5807bd45acaeb0f25907755c4d P 77d69623f6454c198ca53ba2fbe5fc37: Deleting consensus metadata
I20260929 06:38:20.574298 17851 tablet_service.cc:1467] Processing CreateTablet for tablet d588fef16209443aa3ae303591835904 (DEFAULT_TABLE table=test-table [id=116551db2f334b5081ba924c89369082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:20.574417 17851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d588fef16209443aa3ae303591835904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:20.576128 18313 tablet_bootstrap.cc:492] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38: Bootstrap starting.
I20260929 06:38:20.576243 17991 tablet_service.cc:1467] Processing CreateTablet for tablet d588fef16209443aa3ae303591835904 (DEFAULT_TABLE table=test-table [id=116551db2f334b5081ba924c89369082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:20.576344 17991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d588fef16209443aa3ae303591835904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:20.576483 18313 tablet_bootstrap.cc:654] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:20.577006 18313 tablet_bootstrap.cc:492] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38: No bootstrap required, opened a new log
I20260929 06:38:20.577039 18313 ts_tablet_manager.cc:1397] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:20.577157 18313 raft_consensus.cc:348] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.577209 18313 raft_consensus.cc:374] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:20.577224 18313 raft_consensus.cc:729] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d224ae95c2fb4233a22c9133798e3c38, State: Initialized, Role: FOLLOWER
I20260929 06:38:20.577280 18313 consensus_queue.cc:260] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.577409 18313 ts_tablet_manager.cc:1428] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:20.577504 18312 tablet_bootstrap.cc:492] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37: Bootstrap starting.
I20260929 06:38:20.577804 18312 tablet_bootstrap.cc:654] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:20.577826 18301 ts_tablet_manager.cc:1918] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:38:20.577872 18301 log.cc:1196] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-0/wal/wals/c0433e5807bd45acaeb0f25907755c4d
I20260929 06:38:20.578111 18301 ts_tablet_manager.cc:1939] T c0433e5807bd45acaeb0f25907755c4d P d224ae95c2fb4233a22c9133798e3c38: Deleting consensus metadata
I20260929 06:38:20.578392 17701 catalog_manager.cc:4841] TS d224ae95c2fb4233a22c9133798e3c38 (127.15.157.129:43037): tablet c0433e5807bd45acaeb0f25907755c4d (table test-table [id=3434060b16ee4e9d8e2272e92a10f6f6]) successfully deleted
I20260929 06:38:20.578464 18312 tablet_bootstrap.cc:492] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37: No bootstrap required, opened a new log
I20260929 06:38:20.578506 18312 ts_tablet_manager.cc:1397] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:20.578555 18300 ts_tablet_manager.cc:1918] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:38:20.578605 18300 log.cc:1196] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/c0433e5807bd45acaeb0f25907755c4d
I20260929 06:38:20.578614 18312 raft_consensus.cc:348] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.578675 18312 raft_consensus.cc:374] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:20.578701 18312 raft_consensus.cc:729] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d69623f6454c198ca53ba2fbe5fc37, State: Initialized, Role: FOLLOWER
I20260929 06:38:20.578747 18312 consensus_queue.cc:260] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.578815 18300 ts_tablet_manager.cc:1939] T c0433e5807bd45acaeb0f25907755c4d P 47a91ad02eb94d969eb6e9b33875a599: Deleting consensus metadata
I20260929 06:38:20.578841 18312 ts_tablet_manager.cc:1428] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:20.579080 17699 catalog_manager.cc:4841] TS 47a91ad02eb94d969eb6e9b33875a599 (127.15.157.131:35391): tablet c0433e5807bd45acaeb0f25907755c4d (table test-table [id=3434060b16ee4e9d8e2272e92a10f6f6]) successfully deleted
I20260929 06:38:20.579778 18311 tablet_bootstrap.cc:492] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599: Bootstrap starting.
I20260929 06:38:20.579941 17701 catalog_manager.cc:4841] TS 77d69623f6454c198ca53ba2fbe5fc37 (127.15.157.130:35935): tablet c0433e5807bd45acaeb0f25907755c4d (table test-table [id=3434060b16ee4e9d8e2272e92a10f6f6]) successfully deleted
I20260929 06:38:20.580101 18311 tablet_bootstrap.cc:654] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:20.580613 18311 tablet_bootstrap.cc:492] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599: No bootstrap required, opened a new log
I20260929 06:38:20.580654 18311 ts_tablet_manager.cc:1397] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:20.580761 18311 raft_consensus.cc:348] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.580858 18311 raft_consensus.cc:374] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:20.580873 18311 raft_consensus.cc:729] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a91ad02eb94d969eb6e9b33875a599, State: Initialized, Role: FOLLOWER
I20260929 06:38:20.580924 18311 consensus_queue.cc:260] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.581017 18311 ts_tablet_manager.cc:1428] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:20.827418 18281 raft_consensus.cc:482] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:20.827520 18281 raft_consensus.cc:504] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.827729 18281 leader_election.cc:288] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d224ae95c2fb4233a22c9133798e3c38 (127.15.157.129:43037), 47a91ad02eb94d969eb6e9b33875a599 (127.15.157.131:35391)
I20260929 06:38:20.827968 18151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d588fef16209443aa3ae303591835904" candidate_uuid: "77d69623f6454c198ca53ba2fbe5fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a91ad02eb94d969eb6e9b33875a599" is_pre_election: true
I20260929 06:38:20.827968 17871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d588fef16209443aa3ae303591835904" candidate_uuid: "77d69623f6454c198ca53ba2fbe5fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d224ae95c2fb4233a22c9133798e3c38" is_pre_election: true
I20260929 06:38:20.828063 18151 raft_consensus.cc:2454] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77d69623f6454c198ca53ba2fbe5fc37 in term 0.
I20260929 06:38:20.828063 17871 raft_consensus.cc:2454] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77d69623f6454c198ca53ba2fbe5fc37 in term 0.
I20260929 06:38:20.828202 17943 leader_election.cc:302] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a91ad02eb94d969eb6e9b33875a599, 77d69623f6454c198ca53ba2fbe5fc37; no voters:
I20260929 06:38:20.828285 18281 raft_consensus.cc:2781] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:20.828322 18281 raft_consensus.cc:482] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:20.828341 18281 raft_consensus.cc:3037] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:20.829110 18281 raft_consensus.cc:504] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.829252 18281 leader_election.cc:288] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [CANDIDATE]: Term 1 election: Requested vote from peers d224ae95c2fb4233a22c9133798e3c38 (127.15.157.129:43037), 47a91ad02eb94d969eb6e9b33875a599 (127.15.157.131:35391)
I20260929 06:38:20.829376 17871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d588fef16209443aa3ae303591835904" candidate_uuid: "77d69623f6454c198ca53ba2fbe5fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d224ae95c2fb4233a22c9133798e3c38"
I20260929 06:38:20.829376 18151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d588fef16209443aa3ae303591835904" candidate_uuid: "77d69623f6454c198ca53ba2fbe5fc37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a91ad02eb94d969eb6e9b33875a599"
I20260929 06:38:20.829453 17871 raft_consensus.cc:3037] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:20.829453 18151 raft_consensus.cc:3037] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:20.830217 17871 raft_consensus.cc:2454] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d69623f6454c198ca53ba2fbe5fc37 in term 1.
I20260929 06:38:20.830217 18151 raft_consensus.cc:2454] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d69623f6454c198ca53ba2fbe5fc37 in term 1.
I20260929 06:38:20.830410 17945 leader_election.cc:302] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77d69623f6454c198ca53ba2fbe5fc37, d224ae95c2fb4233a22c9133798e3c38; no voters:
I20260929 06:38:20.830576 18281 raft_consensus.cc:2781] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:20.830638 18281 raft_consensus.cc:686] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 LEADER]: Becoming Leader. State: Replica: 77d69623f6454c198ca53ba2fbe5fc37, State: Running, Role: LEADER
I20260929 06:38:20.830695 18281 consensus_queue.cc:237] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } }
I20260929 06:38:20.831262 17713 catalog_manager.cc:5495] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77d69623f6454c198ca53ba2fbe5fc37 (127.15.157.130). New cstate: current_term: 1 leader_uuid: "77d69623f6454c198ca53ba2fbe5fc37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d69623f6454c198ca53ba2fbe5fc37" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 } health_report { overall_health: UNKNOWN } } }
I20260929 06:38:20.866220 18321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:20.864066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34068 (local address 127.15.157.130:35935)
0929 06:38:20.864106 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:20.864108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:20.864117 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:20.864174 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:20.864174 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:20.864185 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:20.864236 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:20.864321 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.864817 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.865576 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:20.865760 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:20.865848 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:20.865955 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:20.865981 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:20.866060 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:20.866141 (+ 81us) server_negotiation.cc:299] Negotiation successful
0929 06:38:20.866160 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 06:38:20.868464 17871 raft_consensus.cc:1261] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Refusing update from remote peer 77d69623f6454c198ca53ba2fbe5fc37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:20.868469 18151 raft_consensus.cc:1261] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Refusing update from remote peer 77d69623f6454c198ca53ba2fbe5fc37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:20.868700 18228 consensus_queue.cc:1035] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d224ae95c2fb4233a22c9133798e3c38" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:20.868815 18281 consensus_queue.cc:1035] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47a91ad02eb94d969eb6e9b33875a599" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 06:38:20.872865 18279 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260929 06:38:22.389026 17713 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:22.389137 17713 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:22.390034 17713 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a866ba6e7804475db960526dd22c53a7: Sending DeleteTablet for 3 replicas of tablet d588fef16209443aa3ae303591835904
I20260929 06:38:22.390282 17851 tablet_service.cc:1514] Processing DeleteTablet for tablet d588fef16209443aa3ae303591835904 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:22 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:44608
I20260929 06:38:22.390313 18131 tablet_service.cc:1514] Processing DeleteTablet for tablet d588fef16209443aa3ae303591835904 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:22 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:48642
I20260929 06:38:22.390482 18362 tablet_replica.cc:330] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38: stopping tablet replica
I20260929 06:38:22.390491 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 17786
I20260929 06:38:22.390542 18362 raft_consensus.cc:2229] T d588fef16209443aa3ae303591835904 P d224ae95c2fb4233a22c9133798e3c38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:22.390955 17991 tablet_service.cc:1514] Processing DeleteTablet for tablet d588fef16209443aa3ae303591835904 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:22 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:34036
I20260929 06:38:22.391124 18364 tablet_replica.cc:330] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37: stopping tablet replica
I20260929 06:38:22.391196 18364 raft_consensus.cc:2229] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:38:22.391263 18364 raft_consensus.cc:2258] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:22.391484 18364 ts_tablet_manager.cc:1905] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:22.393462 18364 ts_tablet_manager.cc:1918] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 06:38:22.393527 18364 log.cc:1196] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/d588fef16209443aa3ae303591835904
I20260929 06:38:22.393798 18364 ts_tablet_manager.cc:1939] T d588fef16209443aa3ae303591835904 P 77d69623f6454c198ca53ba2fbe5fc37: Deleting consensus metadata
I20260929 06:38:22.394265 17701 catalog_manager.cc:4841] TS 77d69623f6454c198ca53ba2fbe5fc37 (127.15.157.130:35935): tablet d588fef16209443aa3ae303591835904 (table test-table [id=116551db2f334b5081ba924c89369082]) successfully deleted
I20260929 06:38:22.398005 18363 tablet_replica.cc:330] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599: stopping tablet replica
I20260929 06:38:22.398113 18363 raft_consensus.cc:2229] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:22.398160 18363 raft_consensus.cc:2258] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260929 06:38:22.398283 17701 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:43037 (error 108)
I20260929 06:38:22.398427 18363 ts_tablet_manager.cc:1905] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:22.398856 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 17926
I20260929 06:38:22.399852 18366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:22.398730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:43037 (local address 127.0.0.1:44634)
0929 06:38:22.398852 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:22.398907 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:43037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":75,"threads_started":1}
W20260929 06:38:22.400115 17701 catalog_manager.cc:4584] TS d224ae95c2fb4233a22c9133798e3c38 (127.15.157.129:43037): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d588fef16209443aa3ae303591835904: Network error: Client connection negotiation failed: client connection to 127.15.157.129:43037: connect: Connection refused (error 111)
I20260929 06:38:22.403941 18363 ts_tablet_manager.cc:1918] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 06:38:22.404009 18363 log.cc:1196] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/d588fef16209443aa3ae303591835904
I20260929 06:38:22.404197 18363 ts_tablet_manager.cc:1939] T d588fef16209443aa3ae303591835904 P 47a91ad02eb94d969eb6e9b33875a599: Deleting consensus metadata
I20260929 06:38:22.404182 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 18066
I20260929 06:38:22.409548 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 17682
I20260929 06:38:22.409572 18366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:22.409450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:35391 (local address 127.0.0.1:48656)
0929 06:38:22.409507 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:22.409536 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.131:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
2026-09-29T06:38:22Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5940 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:22 dist-test-slave-ltw5 krb5kdc[18369](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:22 dist-test-slave-ltw5 krb5kdc[18369](info): set up 2 sockets
Sep 29 06:38:22 dist-test-slave-ltw5 krb5kdc[18369](info): commencing operation
krb5kdc: starting...
W20260929 06:38:23.457825 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:38:23 dist-test-slave-ltw5 krb5kdc[18369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663903, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:38:23.575053 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:42605
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:42605
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:23.654363 18382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:23.654587 18382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:23.654620 18382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:23.655792 18382 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:23.655859 18382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:23.655893 18382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:23.655925 18382 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:23.655946 18382 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:23.657398 18382 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:42605
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:42605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:23.657661 18382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:23.657889 18382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:23.662545 18387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:23.662554 18390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:23.662529 18388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:23.662820 18382 server_base.cc:1034] running on GCE node
I20260929 06:38:23.663064 18382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:23.663349 18382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:23.664529 18382 hybrid_clock.cc:648] HybridClock initialized: now 1790663903664508 us; error 31 us; skew 500 ppm
Sep 29 06:38:23 dist-test-slave-ltw5 krb5kdc[18369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663903, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:23.667234 18382 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:38:23.667673 18382 webserver.cc:460] Webserver started at http://127.15.157.190:36211/ using document root <none> and password file <none>
I20260929 06:38:23.667877 18382 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:23.667919 18382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:23.668008 18382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:23.669030 18382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "86f7a791d28f42c8a8fc8fb5d43f0151"
format_stamp: "Formatted at 2026-09-29 06:38:23 on dist-test-slave-ltw5"
server_key: "1814bfe0c57016aa71aa0ec4a6db5a58"
server_key_iv: "e59cf744c82eb7b124cc42bf4d70bf8f"
server_key_version: "encryptionkey@0"
I20260929 06:38:23.669500 18382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "86f7a791d28f42c8a8fc8fb5d43f0151"
format_stamp: "Formatted at 2026-09-29 06:38:23 on dist-test-slave-ltw5"
server_key: "1814bfe0c57016aa71aa0ec4a6db5a58"
server_key_iv: "e59cf744c82eb7b124cc42bf4d70bf8f"
server_key_version: "encryptionkey@0"
I20260929 06:38:23.670969 18382 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:38:23.671738 18397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:23.671921 18382 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:23.672019 18382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "86f7a791d28f42c8a8fc8fb5d43f0151"
format_stamp: "Formatted at 2026-09-29 06:38:23 on dist-test-slave-ltw5"
server_key: "1814bfe0c57016aa71aa0ec4a6db5a58"
server_key_iv: "e59cf744c82eb7b124cc42bf4d70bf8f"
server_key_version: "encryptionkey@0"
I20260929 06:38:23.672072 18382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:23.683833 18382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:23.685705 18382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:23.685815 18382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:23.689357 18382 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:42605
I20260929 06:38:23.689411 18449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:42605 every 8 connection(s)
I20260929 06:38:23.689723 18382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:23.690587 18450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:23.692755 18450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151: Bootstrap starting.
I20260929 06:38:23.693336 18450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:23.693614 18450 log.cc:824] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:23.694319 18450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151: No bootstrap required, opened a new log
I20260929 06:38:23.695853 18450 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f7a791d28f42c8a8fc8fb5d43f0151" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 42605 } }
I20260929 06:38:23.696029 18450 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:23.696075 18450 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f7a791d28f42c8a8fc8fb5d43f0151, State: Initialized, Role: FOLLOWER
I20260929 06:38:23.696250 18450 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f7a791d28f42c8a8fc8fb5d43f0151" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 42605 } }
I20260929 06:38:23.696342 18450 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:23.696383 18450 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:23.696435 18450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:23.696943 18450 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f7a791d28f42c8a8fc8fb5d43f0151" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 42605 } }
I20260929 06:38:23.697057 18450 leader_election.cc:302] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86f7a791d28f42c8a8fc8fb5d43f0151; no voters:
I20260929 06:38:23.697232 18450 leader_election.cc:288] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:23.697263 18453 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:23.697444 18453 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [term 1 LEADER]: Becoming Leader. State: Replica: 86f7a791d28f42c8a8fc8fb5d43f0151, State: Running, Role: LEADER
I20260929 06:38:23.697486 18450 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:23.697562 18453 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f7a791d28f42c8a8fc8fb5d43f0151" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 42605 } }
I20260929 06:38:23.697906 18454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86f7a791d28f42c8a8fc8fb5d43f0151" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f7a791d28f42c8a8fc8fb5d43f0151" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 42605 } } }
I20260929 06:38:23.697909 18455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86f7a791d28f42c8a8fc8fb5d43f0151. Latest consensus state: current_term: 1 leader_uuid: "86f7a791d28f42c8a8fc8fb5d43f0151" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f7a791d28f42c8a8fc8fb5d43f0151" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 42605 } } }
I20260929 06:38:23.698040 18454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:23.698092 18455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:23.698282 18457 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:23.698825 18457 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:23.699319 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 18382
I20260929 06:38:23.699406 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:23.699586 15990 external_mini_cluster.cc:1428] Setting key 323e95caef5a3c805b8024ee8cf17072
I20260929 06:38:23.700585 18457 catalog_manager.cc:1347] Generated new cluster ID: da38117e42444190bf86f4853f2fa843
I20260929 06:38:23.700672 18457 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:38:23 dist-test-slave-ltw5 krb5kdc[18369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663903, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:23.708973 18472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:23.700027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41106 (local address 127.15.157.190:42605)
0929 06:38:23.700173 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:23.700182 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:23.700250 (+ 68us) server_negotiation.cc:407] Connection header received
0929 06:38:23.700358 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:23.700364 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:23.700407 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:23.700581 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:23.701218 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:23.702210 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:23.702965 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:23.703389 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:23.703521 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:23.705761 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:23.705766 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:23.705766 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:23.705777 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:23.707423 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:23.707794 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:23.707797 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:23.707797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:23.707895 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:23.708107 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:23.708108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:23.708109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:23.708339 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:23.708502 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:23.708620 (+ 118us) server_negotiation.cc:299] Negotiation successful
0929 06:38:23.708764 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":79,"threads_started":1}
I20260929 06:38:23.721508 18457 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:23.722160 18457 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:23.724977 18457 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86f7a791d28f42c8a8fc8fb5d43f0151: Generated new TSK 0
I20260929 06:38:23.725164 18457 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:38:23.756307 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:42605
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:23.836340 18476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:23.836539 18476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:23.836561 18476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:23.837695 18476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:23.837745 18476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:23.837792 18476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:23.839208 18476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:42605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:23.839459 18476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:23.839679 18476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:23.844679 18484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:23.844700 18481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:23.844662 18482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:23.844981 18476 server_base.cc:1034] running on GCE node
I20260929 06:38:23.845188 18476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:23.845428 18476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:23.846578 18476 hybrid_clock.cc:648] HybridClock initialized: now 1790663903846560 us; error 45 us; skew 500 ppm
Sep 29 06:38:23 dist-test-slave-ltw5 krb5kdc[18369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663903, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:23.848958 18476 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:38:23.849395 18476 webserver.cc:460] Webserver started at http://127.15.157.129:42347/ using document root <none> and password file <none>
I20260929 06:38:23.849604 18476 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:23.849666 18476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:23.849805 18476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:23.850888 18476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "0e6eb082754b4079be70f9168d45d01f"
format_stamp: "Formatted at 2026-09-29 06:38:23 on dist-test-slave-ltw5"
server_key: "21231923e7c100b52f629acf6cf71076"
server_key_iv: "8cc68971abad92107055bfee7a3bc713"
server_key_version: "encryptionkey@0"
I20260929 06:38:23.851248 18476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "0e6eb082754b4079be70f9168d45d01f"
format_stamp: "Formatted at 2026-09-29 06:38:23 on dist-test-slave-ltw5"
server_key: "21231923e7c100b52f629acf6cf71076"
server_key_iv: "8cc68971abad92107055bfee7a3bc713"
server_key_version: "encryptionkey@0"
I20260929 06:38:23.852553 18476 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:38:23.853255 18491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:23.853421 18476 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:23.853514 18476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "0e6eb082754b4079be70f9168d45d01f"
format_stamp: "Formatted at 2026-09-29 06:38:23 on dist-test-slave-ltw5"
server_key: "21231923e7c100b52f629acf6cf71076"
server_key_iv: "8cc68971abad92107055bfee7a3bc713"
server_key_version: "encryptionkey@0"
I20260929 06:38:23.853593 18476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:23.906536 18476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:23.908490 18476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:23.908655 18476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:23.908900 18476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:23.909206 18476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:23.909260 18476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:23.909299 18476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:23.909327 18476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:23.915457 18476 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:39645
I20260929 06:38:23.915516 18604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:39645 every 8 connection(s)
I20260929 06:38:23.915884 18476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:38:23.921448 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 18476
I20260929 06:38:23.921559 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:38:23.921754 15990 external_mini_cluster.cc:1428] Setting key 0b093309cdeb2a9f0548b0e546dd3a5c
Sep 29 06:38:23 dist-test-slave-ltw5 krb5kdc[18369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663903, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:23.925522 18607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:23.916655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:42605 (local address 127.15.157.129:54157)
0929 06:38:23.916797 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:23.916851 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:23.917353 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:23.917601 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:23.917605 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:23.918234 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:23.918422 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:23.918427 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:23.919137 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:23.919138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:23.919937 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:23.919940 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:23.920342 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:23.920343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:23.920464 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:23.920965 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:23.920974 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:23.922478 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:23.924131 (+ 1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:23.924138 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:23.924141 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:23.924359 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:23.924565 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:23.924566 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:23.924566 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:23.924669 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:23.924916 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:23.924923 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:23.925058 (+ 135us) client_negotiation.cc:769] Sending connection context
0929 06:38:23.925162 (+ 104us) client_negotiation.cc:240] Negotiation successful
0929 06:38:23.925315 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":70,"threads_started":1}
I20260929 06:38:23.926151 18472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:23.916664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:54157 (local address 127.15.157.190:42605)
0929 06:38:23.916723 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:23.916725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:23.916931 (+ 206us) server_negotiation.cc:407] Connection header received
0929 06:38:23.917453 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:23.917455 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:23.917470 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:23.917525 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:23.918536 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:23.919045 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:23.920031 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:23.920242 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:23.920333 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:23.922564 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:23.922566 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:23.922566 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:23.922572 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:23.924032 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:23.924437 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:23.924438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:23.924439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:23.924499 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:23.924741 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:23.924742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:23.924743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:23.924853 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:23.924924 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:23.925184 (+ 260us) server_negotiation.cc:299] Negotiation successful
0929 06:38:23.926088 (+ 904us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260929 06:38:23.926563 18605 heartbeater.cc:347] Connected to a master server at 127.15.157.190:42605
I20260929 06:38:23.926652 18605 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:23.926843 18605 heartbeater.cc:511] Master 127.15.157.190:42605 requested a full tablet report, sending...
I20260929 06:38:23.927343 18414 ts_manager.cc:194] Registered new tserver with Master: 0e6eb082754b4079be70f9168d45d01f (127.15.157.129:39645)
I20260929 06:38:23.927922 18414 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:54157
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:38:23.946291 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:42605
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:24.026109 18610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:24.026328 18610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:24.026353 18610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:24.027504 18610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:24.027539 18610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:24.027566 18610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:24.028944 18610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:42605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:24.029127 18610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:24.029312 18610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:24.034260 18616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:24.034268 18615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:24.034268 18618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:24.034305 18610 server_base.cc:1034] running on GCE node
I20260929 06:38:24.034663 18610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:24.034904 18610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:24.036069 18610 hybrid_clock.cc:648] HybridClock initialized: now 1790663904036064 us; error 35 us; skew 500 ppm
Sep 29 06:38:24 dist-test-slave-ltw5 krb5kdc[18369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663904, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:24.038765 18610 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:38:24.039216 18610 webserver.cc:460] Webserver started at http://127.15.157.130:37885/ using document root <none> and password file <none>
I20260929 06:38:24.039400 18610 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:24.039440 18610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:24.039526 18610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:24.040586 18610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "703c0ca9bd7e4b9f9037b5c573d5ebdc"
format_stamp: "Formatted at 2026-09-29 06:38:24 on dist-test-slave-ltw5"
server_key: "0029aa146a9d0eaa4b78bcf85b553d8c"
server_key_iv: "b434087cf9c4e7b98e81c28a99c8a38c"
server_key_version: "encryptionkey@0"
I20260929 06:38:24.040898 18610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "703c0ca9bd7e4b9f9037b5c573d5ebdc"
format_stamp: "Formatted at 2026-09-29 06:38:24 on dist-test-slave-ltw5"
server_key: "0029aa146a9d0eaa4b78bcf85b553d8c"
server_key_iv: "b434087cf9c4e7b98e81c28a99c8a38c"
server_key_version: "encryptionkey@0"
I20260929 06:38:24.042209 18610 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:24.042892 18625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:24.043043 18610 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:24.043140 18610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "703c0ca9bd7e4b9f9037b5c573d5ebdc"
format_stamp: "Formatted at 2026-09-29 06:38:24 on dist-test-slave-ltw5"
server_key: "0029aa146a9d0eaa4b78bcf85b553d8c"
server_key_iv: "b434087cf9c4e7b98e81c28a99c8a38c"
server_key_version: "encryptionkey@0"
I20260929 06:38:24.043211 18610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:24.059077 18610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:24.061103 18610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:24.061288 18610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:24.061524 18610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:24.061843 18610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:24.061894 18610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:24.061928 18610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:24.061954 18610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:24.067420 18610 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:33961
I20260929 06:38:24.067466 18738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:33961 every 8 connection(s)
I20260929 06:38:24.067777 18610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:38:24.070854 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 18610
I20260929 06:38:24.070971 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:38:24.071151 15990 external_mini_cluster.cc:1428] Setting key 2a03803e40b72480615296d2717f17a6
Sep 29 06:38:24 dist-test-slave-ltw5 krb5kdc[18369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663904, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:24.077023 18472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:24.068484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:57017 (local address 127.15.157.190:42605)
0929 06:38:24.068535 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:24.068537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:24.068783 (+ 246us) server_negotiation.cc:407] Connection header received
0929 06:38:24.069229 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:24.069230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:24.069241 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:24.069301 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:24.070229 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:24.070705 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:24.071837 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:24.072035 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:24.072110 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:24.074225 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:24.074231 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:24.074231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:24.074237 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:24.075674 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:24.076088 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:24.076089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:24.076090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:24.076144 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:24.076397 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:24.076398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:24.076399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:24.076510 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:24.076584 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:24.076841 (+ 257us) server_negotiation.cc:299] Negotiation successful
0929 06:38:24.076931 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:24.077239 18741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:24.068473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:42605 (local address 127.15.157.130:57017)
0929 06:38:24.068632 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:24.068667 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:24.069140 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:24.069372 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:24.069375 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:24.069952 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:24.070159 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:24.070164 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:24.070816 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:24.070817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:24.071735 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:24.071738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:24.072116 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:24.072118 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:24.072248 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:24.072770 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:24.072778 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:24.074128 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:24.075762 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:24.075768 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:24.075771 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:24.076000 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:24.076208 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:24.076209 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:24.076209 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:24.076317 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:24.076573 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:24.076578 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:24.076717 (+ 139us) client_negotiation.cc:769] Sending connection context
0929 06:38:24.076822 (+ 105us) client_negotiation.cc:240] Negotiation successful
0929 06:38:24.076978 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":82,"threads_started":1}
I20260929 06:38:24.077664 18739 heartbeater.cc:347] Connected to a master server at 127.15.157.190:42605
I20260929 06:38:24.077771 18739 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:24.077950 18739 heartbeater.cc:511] Master 127.15.157.190:42605 requested a full tablet report, sending...
I20260929 06:38:24.078342 18414 ts_manager.cc:194] Registered new tserver with Master: 703c0ca9bd7e4b9f9037b5c573d5ebdc (127.15.157.130:33961)
I20260929 06:38:24.078723 18414 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:57017
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:38:24.096506 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:42605
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:24.179050 18744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:24.179286 18744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:24.179323 18744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:24.180481 18744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:24.180549 18744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:24.180593 18744 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:24.182052 18744 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:42605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:24.182322 18744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:24.182545 18744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:24.187423 18752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:24.187427 18749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:24.187427 18750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:24.187645 18744 server_base.cc:1034] running on GCE node
I20260929 06:38:24.187913 18744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:24.188108 18744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:24.189271 18744 hybrid_clock.cc:648] HybridClock initialized: now 1790663904189250 us; error 36 us; skew 500 ppm
Sep 29 06:38:24 dist-test-slave-ltw5 krb5kdc[18369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663904, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:24.191811 18744 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:38:24.192277 18744 webserver.cc:460] Webserver started at http://127.15.157.131:36949/ using document root <none> and password file <none>
I20260929 06:38:24.192513 18744 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:24.192557 18744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:24.192713 18744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:24.193753 18744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "6d007bd32d664138ad672af30832574b"
format_stamp: "Formatted at 2026-09-29 06:38:24 on dist-test-slave-ltw5"
server_key: "7e25c63326f8f000454a934611fbc4c1"
server_key_iv: "5d39fd0807534a04e9b8e1958cd84ef9"
server_key_version: "encryptionkey@0"
I20260929 06:38:24.194172 18744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "6d007bd32d664138ad672af30832574b"
format_stamp: "Formatted at 2026-09-29 06:38:24 on dist-test-slave-ltw5"
server_key: "7e25c63326f8f000454a934611fbc4c1"
server_key_iv: "5d39fd0807534a04e9b8e1958cd84ef9"
server_key_version: "encryptionkey@0"
I20260929 06:38:24.195415 18744 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:24.196106 18759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:24.196249 18744 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:24.196332 18744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "6d007bd32d664138ad672af30832574b"
format_stamp: "Formatted at 2026-09-29 06:38:24 on dist-test-slave-ltw5"
server_key: "7e25c63326f8f000454a934611fbc4c1"
server_key_iv: "5d39fd0807534a04e9b8e1958cd84ef9"
server_key_version: "encryptionkey@0"
I20260929 06:38:24.196386 18744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:24.216548 18744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:24.218421 18744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:24.218528 18744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:24.218701 18744 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:24.219024 18744 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:24.219061 18744 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:24.219084 18744 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:24.219127 18744 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:24.224643 18744 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:43137
I20260929 06:38:24.224711 18872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:43137 every 8 connection(s)
I20260929 06:38:24.225158 18744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:38:24.231180 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 18744
Sep 29 06:38:24 dist-test-slave-ltw5 krb5kdc[18369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663904, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:24.231276 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:38:24.231455 15990 external_mini_cluster.cc:1428] Setting key 540fec190cd2da2a6f60b96c3bd1eeeb
I20260929 06:38:24.234253 18472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:24.225872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:36675 (local address 127.15.157.190:42605)
0929 06:38:24.225913 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:24.225915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:24.226188 (+ 273us) server_negotiation.cc:407] Connection header received
0929 06:38:24.226709 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:24.226710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:24.226722 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:24.226774 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:24.227734 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:24.228219 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:24.229209 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:24.229398 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:24.229489 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:24.231791 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:24.231792 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:24.231792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:24.231800 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:24.233114 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:24.233461 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:24.233462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:24.233462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:24.233510 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:24.233699 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:24.233700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:24.233700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:24.233797 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:24.233846 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:24.234131 (+ 285us) server_negotiation.cc:299] Negotiation successful
0929 06:38:24.234190 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:38:24.234431 18875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:24.225859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:42605 (local address 127.15.157.131:36675)
0929 06:38:24.226062 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:24.226112 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:24.226609 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:24.226856 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:24.226860 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:24.227434 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:24.227628 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:24.227632 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:24.228306 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:24.228307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:24.229103 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:24.229106 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:24.229494 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:24.229496 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:24.229619 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:24.230170 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:24.230178 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:24.231689 (+ 1511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:24.233180 (+ 1491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:24.233185 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:24.233187 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:24.233401 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:24.233563 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:24.233563 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:24.233563 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:24.233652 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:24.233846 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:24.233849 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:24.233968 (+ 119us) client_negotiation.cc:769] Sending connection context
0929 06:38:24.234111 (+ 143us) client_negotiation.cc:240] Negotiation successful
0929 06:38:24.234230 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260929 06:38:24.234826 18873 heartbeater.cc:347] Connected to a master server at 127.15.157.190:42605
I20260929 06:38:24.234941 18873 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:24.235114 18873 heartbeater.cc:511] Master 127.15.157.190:42605 requested a full tablet report, sending...
I20260929 06:38:24.235450 18414 ts_manager.cc:194] Registered new tserver with Master: 6d007bd32d664138ad672af30832574b (127.15.157.131:43137)
I20260929 06:38:24.235828 18414 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:36675
I20260929 06:38:24.242949 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260929 06:38:24.254101 18472 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:24.253242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41110 (local address 127.15.157.190:42605)
0929 06:38:24.253323 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:24.253325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:24.253396 (+ 71us) server_negotiation.cc:407] Connection header received
0929 06:38:24.253443 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:24.253443 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:24.253452 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:24.253510 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:24.253997 (+ 487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41110: BlockingRecv error: recv got EOF from 127.0.0.1:41110 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260929 06:38:24.254923 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 18476
I20260929 06:38:24.259313 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 18610
I20260929 06:38:24.263674 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 18744
I20260929 06:38:24.267737 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 18382
2026-09-29T06:38:24Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1856 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:24 dist-test-slave-ltw5 krb5kdc[18885](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:24 dist-test-slave-ltw5 krb5kdc[18885](info): set up 2 sockets
Sep 29 06:38:24 dist-test-slave-ltw5 krb5kdc[18885](info): commencing operation
krb5kdc: starting...
W20260929 06:38:25.373929 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:38:25 dist-test-slave-ltw5 krb5kdc[18885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663905, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:38:25.490854 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:41571
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:36015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:41571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:25.571018 18898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:25.571290 18898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:25.571329 18898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:25.572542 18898 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:25.572618 18898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:25.572641 18898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:25.572661 18898 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:25.572693 18898 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:25.574313 18898 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:36015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:41571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:41571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:25.574610 18898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:25.574842 18898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:25.579782 18906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:25.579850 18904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:25.580016 18898 server_base.cc:1034] running on GCE node
W20260929 06:38:25.579787 18903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:25.580360 18898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:25.580607 18898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:25.581823 18898 hybrid_clock.cc:648] HybridClock initialized: now 1790663905581805 us; error 26 us; skew 500 ppm
Sep 29 06:38:25 dist-test-slave-ltw5 krb5kdc[18885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663905, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:25.594573 18898 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:38:25.595105 18898 webserver.cc:460] Webserver started at http://127.15.157.190:35527/ using document root <none> and password file <none>
I20260929 06:38:25.595346 18898 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:25.595423 18898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:25.595571 18898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:25.596691 18898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "b78a0e90c5d449039398df594a329551"
format_stamp: "Formatted at 2026-09-29 06:38:25 on dist-test-slave-ltw5"
server_key: "6401cdebc52fe9591fedac4d67b32973"
server_key_iv: "a7d1717284304f489b1088de2aea3d43"
server_key_version: "encryptionkey@0"
I20260929 06:38:25.597061 18898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "b78a0e90c5d449039398df594a329551"
format_stamp: "Formatted at 2026-09-29 06:38:25 on dist-test-slave-ltw5"
server_key: "6401cdebc52fe9591fedac4d67b32973"
server_key_iv: "a7d1717284304f489b1088de2aea3d43"
server_key_version: "encryptionkey@0"
I20260929 06:38:25.598476 18898 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:38:25.599188 18913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:25.599357 18898 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:25.599469 18898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "b78a0e90c5d449039398df594a329551"
format_stamp: "Formatted at 2026-09-29 06:38:25 on dist-test-slave-ltw5"
server_key: "6401cdebc52fe9591fedac4d67b32973"
server_key_iv: "a7d1717284304f489b1088de2aea3d43"
server_key_version: "encryptionkey@0"
I20260929 06:38:25.599541 18898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:25.613948 18898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:25.616261 18898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:25.616438 18898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:25.620465 18898 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:41571
I20260929 06:38:25.620501 18965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:41571 every 8 connection(s)
I20260929 06:38:25.621006 18898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:25.621637 18966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:25.623819 18966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551: Bootstrap starting.
I20260929 06:38:25.624336 18966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:25.624579 18966 log.cc:824] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:25.625172 18966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551: No bootstrap required, opened a new log
I20260929 06:38:25.625521 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 18898
I20260929 06:38:25.625612 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:25.625775 15990 external_mini_cluster.cc:1428] Setting key 4e2be7c1ef05c37335c786674d990359
I20260929 06:38:25.627836 18966 raft_consensus.cc:348] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78a0e90c5d449039398df594a329551" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41571 } }
I20260929 06:38:25.628010 18966 raft_consensus.cc:374] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:25.628047 18966 raft_consensus.cc:729] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b78a0e90c5d449039398df594a329551, State: Initialized, Role: FOLLOWER
I20260929 06:38:25.628216 18966 consensus_queue.cc:260] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78a0e90c5d449039398df594a329551" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41571 } }
I20260929 06:38:25.628285 18966 raft_consensus.cc:388] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:25.628306 18966 raft_consensus.cc:482] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:25.628378 18966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:25.629006 18966 raft_consensus.cc:504] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78a0e90c5d449039398df594a329551" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41571 } }
I20260929 06:38:25.629108 18966 leader_election.cc:302] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b78a0e90c5d449039398df594a329551; no voters:
I20260929 06:38:25.629251 18966 leader_election.cc:288] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:25.629307 18971 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:25.629446 18971 raft_consensus.cc:686] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [term 1 LEADER]: Becoming Leader. State: Replica: b78a0e90c5d449039398df594a329551, State: Running, Role: LEADER
I20260929 06:38:25.629503 18966 sys_catalog.cc:564] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:25.629570 18971 consensus_queue.cc:237] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78a0e90c5d449039398df594a329551" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41571 } }
I20260929 06:38:25.629966 18973 sys_catalog.cc:455] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b78a0e90c5d449039398df594a329551" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78a0e90c5d449039398df594a329551" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41571 } } }
I20260929 06:38:25.630079 18973 sys_catalog.cc:458] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:25.629954 18971 sys_catalog.cc:455] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b78a0e90c5d449039398df594a329551. Latest consensus state: current_term: 1 leader_uuid: "b78a0e90c5d449039398df594a329551" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78a0e90c5d449039398df594a329551" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41571 } } }
I20260929 06:38:25.630143 18971 sys_catalog.cc:458] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:25.630312 18979 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:25.630888 18979 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:25.632375 18979 catalog_manager.cc:1347] Generated new cluster ID: 00a3380e5ae54baa8c5e18cebbe5386d
I20260929 06:38:25.632432 18979 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:38:25 dist-test-slave-ltw5 krb5kdc[18885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663905, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:25.638599 18970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:25.626248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40554 (local address 127.15.157.190:41571)
0929 06:38:25.626466 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:25.626476 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:25.626513 (+ 37us) server_negotiation.cc:407] Connection header received
0929 06:38:25.627805 (+ 1292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:25.627814 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:25.627887 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:25.628043 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:25.628784 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:25.630258 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:25.631434 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:25.632023 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:25.632122 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:25.634932 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:25.634936 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:25.634936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:25.634947 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:25.636896 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:25.637279 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:25.637282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:25.637282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:25.637405 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:25.637601 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:25.637602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:25.637603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:25.637911 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:25.638110 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:25.638196 (+ 86us) server_negotiation.cc:299] Negotiation successful
0929 06:38:25.638362 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":102,"threads_started":1}
I20260929 06:38:25.639479 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:38:25.649900 18979 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:25.650427 18979 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:25.654083 18979 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b78a0e90c5d449039398df594a329551: Generated new TSK 0
I20260929 06:38:25.654253 18979 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:38:25.655611 18970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:25.651565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40560 (local address 127.15.157.190:41571)
0929 06:38:25.651602 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:25.651604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:25.651758 (+ 154us) server_negotiation.cc:407] Connection header received
0929 06:38:25.651821 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:25.651822 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:25.651832 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:25.651885 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:25.652267 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:25.652981 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:25.654089 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:25.654412 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:25.654455 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:25.655152 (+ 697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:25.655154 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:25.655154 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:25.655370 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:25.655386 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:25.655392 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:25.655443 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:25.655520 (+ 77us) server_negotiation.cc:299] Negotiation successful
0929 06:38:25.655541 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:38:25.657660 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 18898
2026-09-29T06:38:25Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1388 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:25 dist-test-slave-ltw5 krb5kdc[18999](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:25 dist-test-slave-ltw5 krb5kdc[18999](info): set up 2 sockets
Sep 29 06:38:25 dist-test-slave-ltw5 krb5kdc[18999](info): commencing operation
krb5kdc: starting...
W20260929 06:38:26.677870 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.002s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:38:26 dist-test-slave-ltw5 krb5kdc[18999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:38:26.790253 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:46485
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:39277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:46485
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:26.869509 19012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:26.869712 19012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:26.869741 19012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:26.870844 19012 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:26.870882 19012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:26.870896 19012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:26.870908 19012 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:26.870920 19012 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:26.872323 19012 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:39277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:46485
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:46485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:26.872514 19012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:26.872697 19012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:26.877578 19018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:26.877584 19020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:26.877593 19017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:26.877863 19012 server_base.cc:1034] running on GCE node
I20260929 06:38:26.878157 19012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:26.878448 19012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:26.879642 19012 hybrid_clock.cc:648] HybridClock initialized: now 1790663906879628 us; error 27 us; skew 500 ppm
Sep 29 06:38:26 dist-test-slave-ltw5 krb5kdc[18999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663906, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:26.882246 19012 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:38:26.882730 19012 webserver.cc:460] Webserver started at http://127.15.157.190:46245/ using document root <none> and password file <none>
I20260929 06:38:26.883001 19012 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:26.883064 19012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:26.883208 19012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:26.884301 19012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "42f7a2f282144d9a8f62af54589c9be2"
format_stamp: "Formatted at 2026-09-29 06:38:26 on dist-test-slave-ltw5"
server_key: "7d0fe97af8dcbb479ae66a4156bfaf8c"
server_key_iv: "29c14056182cfb3592f179b2dc904759"
server_key_version: "encryptionkey@0"
I20260929 06:38:26.884653 19012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "42f7a2f282144d9a8f62af54589c9be2"
format_stamp: "Formatted at 2026-09-29 06:38:26 on dist-test-slave-ltw5"
server_key: "7d0fe97af8dcbb479ae66a4156bfaf8c"
server_key_iv: "29c14056182cfb3592f179b2dc904759"
server_key_version: "encryptionkey@0"
I20260929 06:38:26.885952 19012 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260929 06:38:26.886684 19027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:26.886869 19012 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:26.886950 19012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "42f7a2f282144d9a8f62af54589c9be2"
format_stamp: "Formatted at 2026-09-29 06:38:26 on dist-test-slave-ltw5"
server_key: "7d0fe97af8dcbb479ae66a4156bfaf8c"
server_key_iv: "29c14056182cfb3592f179b2dc904759"
server_key_version: "encryptionkey@0"
I20260929 06:38:26.887002 19012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:26.897612 19012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:26.899580 19012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:26.899681 19012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:26.903314 19012 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:46485
I20260929 06:38:26.903367 19079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:46485 every 8 connection(s)
I20260929 06:38:26.903677 19012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:26.904376 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 19012
I20260929 06:38:26.904456 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:26.904645 15990 external_mini_cluster.cc:1428] Setting key 5725c350d2f6916db0cc406b7c9585a6
I20260929 06:38:26.904778 19080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:26.907573 19080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2: Bootstrap starting.
I20260929 06:38:26.908130 19080 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:26.908413 19080 log.cc:824] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:26.909127 19080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2: No bootstrap required, opened a new log
I20260929 06:38:26.911600 19080 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f7a2f282144d9a8f62af54589c9be2" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46485 } }
I20260929 06:38:26.911777 19080 raft_consensus.cc:374] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:26.911829 19080 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42f7a2f282144d9a8f62af54589c9be2, State: Initialized, Role: FOLLOWER
I20260929 06:38:26.911957 19080 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f7a2f282144d9a8f62af54589c9be2" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46485 } }
I20260929 06:38:26.912128 19080 raft_consensus.cc:388] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
Sep 29 06:38:26 dist-test-slave-ltw5 krb5kdc[18999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:26.912205 19080 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:26.912281 19080 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:26.912863 19080 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f7a2f282144d9a8f62af54589c9be2" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46485 } }
I20260929 06:38:26.913003 19080 leader_election.cc:302] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42f7a2f282144d9a8f62af54589c9be2; no voters:
I20260929 06:38:26.913203 19080 leader_election.cc:288] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:26.913255 19085 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:26.913440 19085 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [term 1 LEADER]: Becoming Leader. State: Replica: 42f7a2f282144d9a8f62af54589c9be2, State: Running, Role: LEADER
I20260929 06:38:26.913529 19080 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:26.913578 19085 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f7a2f282144d9a8f62af54589c9be2" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46485 } }
I20260929 06:38:26.913916 19085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42f7a2f282144d9a8f62af54589c9be2. Latest consensus state: current_term: 1 leader_uuid: "42f7a2f282144d9a8f62af54589c9be2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f7a2f282144d9a8f62af54589c9be2" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46485 } } }
I20260929 06:38:26.913930 19086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "42f7a2f282144d9a8f62af54589c9be2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f7a2f282144d9a8f62af54589c9be2" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46485 } } }
I20260929 06:38:26.914139 19086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:26.914465 19085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2 [sys.catalog]: This master's current role is: LEADER
W20260929 06:38:26.915871 19101 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:38:26.915966 19101 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:38:26.916059 19092 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:26.916265 19092 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:26.916532 19083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:26.905096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42988 (local address 127.15.157.190:46485)
0929 06:38:26.905246 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:26.905255 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:26.906226 (+ 971us) server_negotiation.cc:407] Connection header received
0929 06:38:26.906619 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:26.906625 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:26.906666 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:26.906777 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:26.907554 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:26.908502 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:26.909497 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:26.909886 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:26.909966 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:26.912667 (+ 2701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:26.912671 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:26.912672 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:26.912688 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:26.914871 (+ 2183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:26.915217 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:26.915220 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:26.915221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:26.915348 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:26.915615 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:26.915617 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:26.915617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:26.915873 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:26.916046 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:26.916170 (+ 124us) server_negotiation.cc:299] Negotiation successful
0929 06:38:26.916318 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":68,"threads_started":1}
I20260929 06:38:26.917778 19092 catalog_manager.cc:1347] Generated new cluster ID: 9315f3a42bc640af9eace680646c5446
I20260929 06:38:26.917840 19092 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:26.932243 19092 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:26.932737 19092 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:26.936818 19092 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42f7a2f282144d9a8f62af54589c9be2: Generated new TSK 0
I20260929 06:38:26.936985 19092 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:38:26.968576 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46485
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:39277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:27.048825 19106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:27.049077 19106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:27.049118 19106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:27.050335 19106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:27.050392 19106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:27.050436 19106 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:27.051869 19106 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:39277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46485
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:27.052137 19106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:27.052359 19106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:27.057238 19114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:27.057246 19111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:27.057415 19106 server_base.cc:1034] running on GCE node
W20260929 06:38:27.057299 19112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:27.057740 19106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:27.057940 19106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:27.059075 19106 hybrid_clock.cc:648] HybridClock initialized: now 1790663907059062 us; error 27 us; skew 500 ppm
Sep 29 06:38:27 dist-test-slave-ltw5 krb5kdc[18999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663907, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:27.061508 19106 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:38:27.061960 19106 webserver.cc:460] Webserver started at http://127.15.157.129:41599/ using document root <none> and password file <none>
I20260929 06:38:27.062192 19106 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:27.062237 19106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:27.062382 19106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:27.063381 19106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "cb8b96c938a34873bfe566e25ca16319"
format_stamp: "Formatted at 2026-09-29 06:38:27 on dist-test-slave-ltw5"
server_key: "c2dcc2fb01a60987930a89ee6550624c"
server_key_iv: "555ea68708090ad6b3425aa55bf64c3d"
server_key_version: "encryptionkey@0"
I20260929 06:38:27.063722 19106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "cb8b96c938a34873bfe566e25ca16319"
format_stamp: "Formatted at 2026-09-29 06:38:27 on dist-test-slave-ltw5"
server_key: "c2dcc2fb01a60987930a89ee6550624c"
server_key_iv: "555ea68708090ad6b3425aa55bf64c3d"
server_key_version: "encryptionkey@0"
I20260929 06:38:27.064976 19106 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:38:27.065613 19121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:27.065788 19106 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:27.065881 19106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "cb8b96c938a34873bfe566e25ca16319"
format_stamp: "Formatted at 2026-09-29 06:38:27 on dist-test-slave-ltw5"
server_key: "c2dcc2fb01a60987930a89ee6550624c"
server_key_iv: "555ea68708090ad6b3425aa55bf64c3d"
server_key_version: "encryptionkey@0"
I20260929 06:38:27.065958 19106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:27.084713 19106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:27.086983 19106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:27.087139 19106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:27.087368 19106 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:27.087661 19106 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:27.087710 19106 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:27.087754 19106 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:27.087822 19106 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:27.093564 19106 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:46355
I20260929 06:38:27.093602 19234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:46355 every 8 connection(s)
I20260929 06:38:27.093938 19106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:38:27 dist-test-slave-ltw5 krb5kdc[18999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663907, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:27.102391 19083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:27.094657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:40297 (local address 127.15.157.190:46485)
0929 06:38:27.094716 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:27.094718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:27.094939 (+ 221us) server_negotiation.cc:407] Connection header received
0929 06:38:27.095419 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:27.095420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:27.095430 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:27.095473 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:27.096353 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:27.096841 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:27.097783 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:27.097965 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:27.098049 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:27.099927 (+ 1878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:27.099928 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:27.099929 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:27.099935 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:27.101305 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:27.101619 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:27.101620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:27.101620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:27.101667 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:27.101855 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:27.101856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:27.101856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:27.101951 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:27.101999 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:27.102255 (+ 256us) server_negotiation.cc:299] Negotiation successful
0929 06:38:27.102323 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 06:38:27.102536 19237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:27.094647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46485 (local address 127.15.157.129:40297)
0929 06:38:27.094815 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:27.094855 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:27.095320 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:27.095528 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:27.095531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:27.096093 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:27.096273 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:27.096278 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:27.096909 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:27.096910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:27.097713 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:27.097714 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:27.098064 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:27.098065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:27.098169 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:27.098568 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:27.098576 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:27.099840 (+ 1264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:27.101367 (+ 1527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:27.101372 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:27.101374 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:27.101563 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:27.101718 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:27.101718 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:27.101719 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:27.101804 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:27.102000 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:27.102003 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:27.102151 (+ 148us) client_negotiation.cc:769] Sending connection context
0929 06:38:27.102233 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 06:38:27.102353 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
I20260929 06:38:27.102993 19235 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46485
I20260929 06:38:27.103088 19235 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:27.103255 19235 heartbeater.cc:511] Master 127.15.157.190:46485 requested a full tablet report, sending...
I20260929 06:38:27.103500 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 19106
I20260929 06:38:27.103605 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:38:27.103808 15990 external_mini_cluster.cc:1428] Setting key e8f6e8d12b8c23adb920a3c44f7a4866
I20260929 06:38:27.103868 19044 ts_manager.cc:194] Registered new tserver with Master: cb8b96c938a34873bfe566e25ca16319 (127.15.157.129:46355)
I20260929 06:38:27.104754 19044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:40297
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:38:27.128364 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46485
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:39277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:27.211907 19240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:27.212148 19240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:27.212185 19240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:27.213423 19240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:27.213478 19240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:27.213522 19240 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:27.215150 19240 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:39277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46485
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:27.215402 19240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:27.215651 19240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:27.220482 19245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:27.220546 19248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:27.220522 19240 server_base.cc:1034] running on GCE node
W20260929 06:38:27.220633 19246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:27.221060 19240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:27.221256 19240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:27.222409 19240 hybrid_clock.cc:648] HybridClock initialized: now 1790663907222392 us; error 29 us; skew 500 ppm
Sep 29 06:38:27 dist-test-slave-ltw5 krb5kdc[18999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663907, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:27.224858 19240 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:38:27.225301 19240 webserver.cc:460] Webserver started at http://127.15.157.130:34677/ using document root <none> and password file <none>
I20260929 06:38:27.225507 19240 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:27.225569 19240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:27.225710 19240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:27.226778 19240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "d582d49bb93a4c99853fc6fec3e6c12e"
format_stamp: "Formatted at 2026-09-29 06:38:27 on dist-test-slave-ltw5"
server_key: "4a3e4b52ac9646cec920933b62f6d7f9"
server_key_iv: "68e97e49e0beceaf4c628a67d07b1029"
server_key_version: "encryptionkey@0"
I20260929 06:38:27.227124 19240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "d582d49bb93a4c99853fc6fec3e6c12e"
format_stamp: "Formatted at 2026-09-29 06:38:27 on dist-test-slave-ltw5"
server_key: "4a3e4b52ac9646cec920933b62f6d7f9"
server_key_iv: "68e97e49e0beceaf4c628a67d07b1029"
server_key_version: "encryptionkey@0"
I20260929 06:38:27.228360 19240 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:27.229017 19255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:27.229171 19240 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:27.229264 19240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "d582d49bb93a4c99853fc6fec3e6c12e"
format_stamp: "Formatted at 2026-09-29 06:38:27 on dist-test-slave-ltw5"
server_key: "4a3e4b52ac9646cec920933b62f6d7f9"
server_key_iv: "68e97e49e0beceaf4c628a67d07b1029"
server_key_version: "encryptionkey@0"
I20260929 06:38:27.229333 19240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:27.263125 19240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:27.265441 19240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:27.265600 19240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:27.265847 19240 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:27.266196 19240 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:27.266247 19240 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:27.266283 19240 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:27.266309 19240 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:27.272126 19240 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:33655
I20260929 06:38:27.272167 19368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:33655 every 8 connection(s)
I20260929 06:38:27.272475 19240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:38:27.272895 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 19240
I20260929 06:38:27.273007 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:38:27.273241 15990 external_mini_cluster.cc:1428] Setting key 6014617886bc6ce4e30ab91148dcfdd3
Sep 29 06:38:27 dist-test-slave-ltw5 krb5kdc[18999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663907, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
I20260929 06:38:27.283229 19083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:27.273133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:40851 (local address 127.15.157.190:46485)
0929 06:38:27.273197 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:27.273200 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:27.273438 (+ 238us) server_negotiation.cc:407] Connection header received
0929 06:38:27.274223 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:27.274224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:27.274238 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:27.274324 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:27.275372 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:27.275861 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:27.277633 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:27.277833 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:27.277892 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:27.280462 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:27.280464 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:27.280465 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:27.280472 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:27.281807 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:27.282298 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:27.282300 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:27.282300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:27.282359 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:27.282600 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:27.282601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:27.282601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:27.282708 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:27.282774 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:27.283045 (+ 271us) server_negotiation.cc:299] Negotiation successful
0929 06:38:27.283127 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 06:38:27.283464 19371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:27.273126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46485 (local address 127.15.157.130:40851)
0929 06:38:27.273297 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:27.273349 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:27.274131 (+ 782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:27.274381 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:27.274384 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:27.274971 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:27.275266 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:27.275274 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:27.275946 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:27.275947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:27.277527 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:27.277531 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:27.277938 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:27.277939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:27.278142 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:27.278692 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:27.278702 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:27.280340 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:27.281911 (+ 1571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:27.281917 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:27.281919 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:27.282227 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:27.282422 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:27.282423 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:27.282424 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:27.282533 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:27.282780 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:27.282785 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:27.282914 (+ 129us) client_negotiation.cc:769] Sending connection context
0929 06:38:27.283012 (+ 98us) client_negotiation.cc:240] Negotiation successful
0929 06:38:27.283237 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":86,"threads_started":1}
I20260929 06:38:27.283998 19369 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46485
I20260929 06:38:27.284099 19369 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:27.284318 19369 heartbeater.cc:511] Master 127.15.157.190:46485 requested a full tablet report, sending...
I20260929 06:38:27.284704 19044 ts_manager.cc:194] Registered new tserver with Master: d582d49bb93a4c99853fc6fec3e6c12e (127.15.157.130:33655)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
I20260929 06:38:27.285193 19044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:40851
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:38:27.300206 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46485
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:39277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:27.379679 19374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:27.379891 19374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:27.379913 19374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:27.381024 19374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:27.381065 19374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:27.381095 19374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:27.382485 19374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:39277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46485
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:27.382663 19374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:27.382845 19374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:27.387809 19380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:27.387931 19382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:27.388041 19374 server_base.cc:1034] running on GCE node
W20260929 06:38:27.389942 19379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:27.390206 19374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:27.390446 19374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:27.391603 19374 hybrid_clock.cc:648] HybridClock initialized: now 1790663907391585 us; error 35 us; skew 500 ppm
Sep 29 06:38:27 dist-test-slave-ltw5 krb5kdc[18999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663907, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:27.393989 19374 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:38:27.394496 19374 webserver.cc:460] Webserver started at http://127.15.157.131:46445/ using document root <none> and password file <none>
I20260929 06:38:27.394728 19374 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:27.394794 19374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:27.394940 19374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:27.395988 19374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "93cdc1af21ca4efc8fd2d60978e547cd"
format_stamp: "Formatted at 2026-09-29 06:38:27 on dist-test-slave-ltw5"
server_key: "b88f03e2c2b6ae7d58dac05c9bc1bdf9"
server_key_iv: "1428f39ec7b63928f448fbcb24ec7acd"
server_key_version: "encryptionkey@0"
I20260929 06:38:27.396358 19374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "93cdc1af21ca4efc8fd2d60978e547cd"
format_stamp: "Formatted at 2026-09-29 06:38:27 on dist-test-slave-ltw5"
server_key: "b88f03e2c2b6ae7d58dac05c9bc1bdf9"
server_key_iv: "1428f39ec7b63928f448fbcb24ec7acd"
server_key_version: "encryptionkey@0"
I20260929 06:38:27.397795 19374 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260929 06:38:27.398579 19389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:27.398741 19374 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:27.398836 19374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "93cdc1af21ca4efc8fd2d60978e547cd"
format_stamp: "Formatted at 2026-09-29 06:38:27 on dist-test-slave-ltw5"
server_key: "b88f03e2c2b6ae7d58dac05c9bc1bdf9"
server_key_iv: "1428f39ec7b63928f448fbcb24ec7acd"
server_key_version: "encryptionkey@0"
I20260929 06:38:27.398914 19374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:27.417889 19374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:27.420183 19374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:27.420360 19374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:27.420585 19374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:27.420871 19374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:27.420919 19374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:27.420960 19374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:27.420989 19374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:27.426987 19374 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:37689
I20260929 06:38:27.427039 19502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:37689 every 8 connection(s)
I20260929 06:38:27.427376 19374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:38:27 dist-test-slave-ltw5 krb5kdc[18999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663907, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:27.434641 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 19374
I20260929 06:38:27.434744 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:38:27.434942 15990 external_mini_cluster.cc:1428] Setting key 92a529c8e89c845772f0ea76b1eb97d3
I20260929 06:38:27.436420 19083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:27.428102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:48155 (local address 127.15.157.190:46485)
0929 06:38:27.428163 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:27.428164 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:27.428367 (+ 203us) server_negotiation.cc:407] Connection header received
0929 06:38:27.428839 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:27.428840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:27.428850 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:27.428914 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:27.429811 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:27.430389 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:27.431349 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:27.431530 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:27.431587 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:27.433669 (+ 2082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:27.433670 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:27.433670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:27.433676 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:27.435165 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:27.435592 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:27.435593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:27.435593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:27.435667 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:27.435922 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:27.435922 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:27.435923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:27.436026 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:27.436077 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:27.436297 (+ 220us) server_negotiation.cc:299] Negotiation successful
0929 06:38:27.436354 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 06:38:27.436689 19505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:27.428071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46485 (local address 127.15.157.131:48155)
0929 06:38:27.428244 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:27.428285 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:27.428761 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:27.428971 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:27.428975 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:27.429531 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:27.429722 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:27.429726 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:27.430469 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:27.430470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:27.431273 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:27.431275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:27.431617 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:27.431618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:27.431715 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:27.432212 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:27.432222 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:27.433591 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:27.435223 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:27.435230 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:27.435232 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:27.435514 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:27.435748 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:27.435749 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:27.435749 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:27.435876 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:27.436080 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:27.436083 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:27.436193 (+ 110us) client_negotiation.cc:769] Sending connection context
0929 06:38:27.436274 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 06:38:27.436437 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":104,"threads_started":1}
I20260929 06:38:27.437119 19503 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46485
I20260929 06:38:27.437219 19503 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:27.437392 19503 heartbeater.cc:511] Master 127.15.157.190:46485 requested a full tablet report, sending...
I20260929 06:38:27.437740 19044 ts_manager.cc:194] Registered new tserver with Master: 93cdc1af21ca4efc8fd2d60978e547cd (127.15.157.131:37689)
I20260929 06:38:27.438126 19044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:48155
I20260929 06:38:27.446643 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 06:38:27 dist-test-slave-ltw5 krb5kdc[18999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663907, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Sep 29 06:38:27 dist-test-slave-ltw5 krb5kdc[18999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663907, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:27.467844 19083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:27.461224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45120 (local address 127.15.157.190:46485)
0929 06:38:27.461293 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:27.461295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:27.461411 (+ 116us) server_negotiation.cc:407] Connection header received
0929 06:38:27.461463 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:27.461464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:27.461473 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:27.461524 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:27.462122 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:27.462608 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:27.463299 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:27.463468 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:27.463515 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:27.465590 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:27.465591 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:27.465592 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:27.465598 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:27.466941 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:27.467210 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:27.467211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:27.467211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:27.467258 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:27.467405 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:27.467405 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:27.467406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:27.467535 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:27.467604 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:27.467683 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 06:38:27.467739 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260929 06:38:27.468093 19044 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:45120
I20260929 06:38:27.468672 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 19106
I20260929 06:38:27.473438 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 19240
I20260929 06:38:27.477733 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 19374
I20260929 06:38:27.481818 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 19012
2026-09-29T06:38:27Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1825 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:27 dist-test-slave-ltw5 krb5kdc[19515](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:27 dist-test-slave-ltw5 krb5kdc[19515](info): set up 2 sockets
Sep 29 06:38:27 dist-test-slave-ltw5 krb5kdc[19515](info): commencing operation
krb5kdc: starting...
W20260929 06:38:28.521803 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:38:28 dist-test-slave-ltw5 krb5kdc[19515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:38:28.636538 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:37271
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:46673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:37271
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:28.715142 19528 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:28.715361 19528 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:28.715394 19528 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:28.716513 19528 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:28.716574 19528 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:28.716596 19528 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:28.716617 19528 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:28.716645 19528 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:28.718112 19528 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:46673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:37271
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:37271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19528
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:28.718358 19528 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:28.718564 19528 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:28.723253 19536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:28.723249 19534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:28.723249 19533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:28.723533 19528 server_base.cc:1034] running on GCE node
I20260929 06:38:28.723773 19528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:28.724046 19528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:28.725203 19528 hybrid_clock.cc:648] HybridClock initialized: now 1790663908725183 us; error 54 us; skew 500 ppm
Sep 29 06:38:28 dist-test-slave-ltw5 krb5kdc[19515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663908, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:28.727550 19528 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:38:28.727955 19528 webserver.cc:460] Webserver started at http://127.15.157.190:45929/ using document root <none> and password file <none>
I20260929 06:38:28.728140 19528 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:28.728188 19528 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:28.728277 19528 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:28.729230 19528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "288a1e75d2b74b86bba988d5e2fbcd74"
format_stamp: "Formatted at 2026-09-29 06:38:28 on dist-test-slave-ltw5"
server_key: "76449d7d0278d70b9d54cec2e3c1b903"
server_key_iv: "5815185c50b02355982150e79da58a0d"
server_key_version: "encryptionkey@0"
I20260929 06:38:28.729516 19528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "288a1e75d2b74b86bba988d5e2fbcd74"
format_stamp: "Formatted at 2026-09-29 06:38:28 on dist-test-slave-ltw5"
server_key: "76449d7d0278d70b9d54cec2e3c1b903"
server_key_iv: "5815185c50b02355982150e79da58a0d"
server_key_version: "encryptionkey@0"
I20260929 06:38:28.730824 19528 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:38:28.731508 19543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:28.731705 19528 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:28.731773 19528 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "288a1e75d2b74b86bba988d5e2fbcd74"
format_stamp: "Formatted at 2026-09-29 06:38:28 on dist-test-slave-ltw5"
server_key: "76449d7d0278d70b9d54cec2e3c1b903"
server_key_iv: "5815185c50b02355982150e79da58a0d"
server_key_version: "encryptionkey@0"
I20260929 06:38:28.731822 19528 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:28.761792 19528 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:28.764071 19528 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:28.764187 19528 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:28.768217 19528 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:37271
I20260929 06:38:28.768272 19595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:37271 every 8 connection(s)
I20260929 06:38:28.768764 19528 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:28.769421 19596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:28.770866 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 19528
I20260929 06:38:28.770975 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:28.771195 15990 external_mini_cluster.cc:1428] Setting key 5c6eb7572852fd21b77ee4e8c9eb9329
I20260929 06:38:28.772275 19596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74: Bootstrap starting.
I20260929 06:38:28.773022 19596 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:28.773387 19596 log.cc:824] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:28.774194 19596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74: No bootstrap required, opened a new log
I20260929 06:38:28.776552 19596 raft_consensus.cc:348] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288a1e75d2b74b86bba988d5e2fbcd74" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 37271 } }
I20260929 06:38:28.776736 19596 raft_consensus.cc:374] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:28.776782 19596 raft_consensus.cc:729] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a1e75d2b74b86bba988d5e2fbcd74, State: Initialized, Role: FOLLOWER
I20260929 06:38:28.776942 19596 consensus_queue.cc:260] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288a1e75d2b74b86bba988d5e2fbcd74" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 37271 } }
I20260929 06:38:28.777033 19596 raft_consensus.cc:388] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:28.777073 19596 raft_consensus.cc:482] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:28.777132 19596 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:28.777884 19596 raft_consensus.cc:504] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288a1e75d2b74b86bba988d5e2fbcd74" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 37271 } }
I20260929 06:38:28.778002 19596 leader_election.cc:302] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 288a1e75d2b74b86bba988d5e2fbcd74; no voters:
I20260929 06:38:28.778213 19596 leader_election.cc:288] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:28.778239 19601 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [term 1 FOLLOWER]: Leader election won for term 1
Sep 29 06:38:28 dist-test-slave-ltw5 krb5kdc[19515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:28.778345 19601 raft_consensus.cc:686] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [term 1 LEADER]: Becoming Leader. State: Replica: 288a1e75d2b74b86bba988d5e2fbcd74, State: Running, Role: LEADER
I20260929 06:38:28.778437 19601 consensus_queue.cc:237] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288a1e75d2b74b86bba988d5e2fbcd74" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 37271 } }
I20260929 06:38:28.778487 19596 sys_catalog.cc:564] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:28.778769 19603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 288a1e75d2b74b86bba988d5e2fbcd74. Latest consensus state: current_term: 1 leader_uuid: "288a1e75d2b74b86bba988d5e2fbcd74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288a1e75d2b74b86bba988d5e2fbcd74" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 37271 } } }
I20260929 06:38:28.778858 19603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:28.779102 19606 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:28.779654 19606 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:28.780300 19602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "288a1e75d2b74b86bba988d5e2fbcd74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288a1e75d2b74b86bba988d5e2fbcd74" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 37271 } } }
I20260929 06:38:28.780390 19602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:28.781474 19606 catalog_manager.cc:1347] Generated new cluster ID: 188320b975914e9eaa3102602df5a7ae
I20260929 06:38:28.781522 19606 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:28.782692 19599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:28.771736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44720 (local address 127.15.157.190:37271)
0929 06:38:28.771898 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:28.771907 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:28.771940 (+ 33us) server_negotiation.cc:407] Connection header received
0929 06:38:28.772379 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:28.772403 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:28.772471 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:28.772593 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:28.773425 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:28.774588 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:28.775610 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:28.776013 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:28.776090 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:28.778949 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:28.778953 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:28.778954 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:28.778967 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:28.781059 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:28.781446 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:28.781449 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:28.781449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:28.781555 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:28.781761 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:28.781762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:28.781762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:28.782088 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:28.782231 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:28.782359 (+ 128us) server_negotiation.cc:299] Negotiation successful
0929 06:38:28.782489 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":84,"threads_started":1}
I20260929 06:38:28.795830 19606 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:28.796398 19606 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:28.799911 19606 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 288a1e75d2b74b86bba988d5e2fbcd74: Generated new TSK 0
I20260929 06:38:28.800093 19606 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:38:28.827358 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:37271
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:46673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:28.907228 19622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:28.907433 19622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:28.907455 19622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:28.908522 19622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:28.908557 19622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:28.908582 19622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:28.909974 19622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:46673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:37271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:28.910209 19622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:28.910379 19622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:28.915138 19627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:28.915145 19628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:28.915150 19630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:28.915454 19622 server_base.cc:1034] running on GCE node
I20260929 06:38:28.915632 19622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:28.915848 19622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:28.916980 19622 hybrid_clock.cc:648] HybridClock initialized: now 1790663908916966 us; error 27 us; skew 500 ppm
Sep 29 06:38:28 dist-test-slave-ltw5 krb5kdc[19515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663908, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:28.919418 19622 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:38:28.919852 19622 webserver.cc:460] Webserver started at http://127.15.157.129:33163/ using document root <none> and password file <none>
I20260929 06:38:28.920034 19622 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:28.920073 19622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:28.920156 19622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:28.921103 19622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "92f1021e476c48d68cde2d17773ac0d0"
format_stamp: "Formatted at 2026-09-29 06:38:28 on dist-test-slave-ltw5"
server_key: "34902f2028a78527b8da5265ccf6b175"
server_key_iv: "c2f3e7c9464e2f93b129e4cbb72fd3c9"
server_key_version: "encryptionkey@0"
I20260929 06:38:28.921396 19622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "92f1021e476c48d68cde2d17773ac0d0"
format_stamp: "Formatted at 2026-09-29 06:38:28 on dist-test-slave-ltw5"
server_key: "34902f2028a78527b8da5265ccf6b175"
server_key_iv: "c2f3e7c9464e2f93b129e4cbb72fd3c9"
server_key_version: "encryptionkey@0"
I20260929 06:38:28.922791 19622 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:38:28.923413 19637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:28.923568 19622 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:28.923657 19622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "92f1021e476c48d68cde2d17773ac0d0"
format_stamp: "Formatted at 2026-09-29 06:38:28 on dist-test-slave-ltw5"
server_key: "34902f2028a78527b8da5265ccf6b175"
server_key_iv: "c2f3e7c9464e2f93b129e4cbb72fd3c9"
server_key_version: "encryptionkey@0"
I20260929 06:38:28.923729 19622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:28.936249 19622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:28.938396 19622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:28.938541 19622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:28.938738 19622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:28.939009 19622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:28.939059 19622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:28.939096 19622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:28.939124 19622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:28.944814 19622 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:33549
I20260929 06:38:28.944854 19750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:33549 every 8 connection(s)
I20260929 06:38:28.945140 19622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:38:28 dist-test-slave-ltw5 krb5kdc[19515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663908, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:28.952082 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 19622
I20260929 06:38:28.952190 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:38:28.952395 15990 external_mini_cluster.cc:1428] Setting key 1eba050a028daf0d92f0784fe6dc9b5f
I20260929 06:38:28.954246 19599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:28.945791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:44317 (local address 127.15.157.190:37271)
0929 06:38:28.945860 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:28.945862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:28.946085 (+ 223us) server_negotiation.cc:407] Connection header received
0929 06:38:28.946996 (+ 911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:28.946997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:28.947010 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:28.947074 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:28.947644 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:28.948174 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:28.949138 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:28.949362 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:28.949443 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:28.951426 (+ 1983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:28.951428 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:28.951428 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:28.951436 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:28.952866 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:28.953296 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:28.953297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:28.953298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:28.953367 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:28.953601 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:28.953602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:28.953602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:28.953718 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:28.953791 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:28.954071 (+ 280us) server_negotiation.cc:299] Negotiation successful
0929 06:38:28.954157 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260929 06:38:28.954418 19753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:28.945797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:37271 (local address 127.15.157.129:44317)
0929 06:38:28.945954 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:28.945986 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:28.946889 (+ 903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:28.947143 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:28.947146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:28.947380 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:28.947553 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:28.947556 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:28.948268 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:28.948269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:28.949049 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:28.949051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:28.949451 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:28.949452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:28.949569 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:28.950062 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:28.950070 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:28.951335 (+ 1265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:28.952946 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:28.952951 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:28.952953 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:28.953211 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:28.953428 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:28.953429 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:28.953429 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:28.953538 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:28.953781 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:28.953786 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:28.953926 (+ 140us) client_negotiation.cc:769] Sending connection context
0929 06:38:28.954048 (+ 122us) client_negotiation.cc:240] Negotiation successful
0929 06:38:28.954196 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260929 06:38:28.954876 19751 heartbeater.cc:347] Connected to a master server at 127.15.157.190:37271
I20260929 06:38:28.954959 19751 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:28.955138 19751 heartbeater.cc:511] Master 127.15.157.190:37271 requested a full tablet report, sending...
I20260929 06:38:28.955646 19560 ts_manager.cc:194] Registered new tserver with Master: 92f1021e476c48d68cde2d17773ac0d0 (127.15.157.129:33549)
I20260929 06:38:28.956590 19560 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:44317
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:38:28.976466 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:37271
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:46673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:29.056404 19756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:29.056602 19756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:29.056625 19756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:29.057782 19756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:29.057823 19756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:29.057879 19756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:29.059376 19756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:46673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:37271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:29.059617 19756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:29.059846 19756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:29.064846 19764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:29.064885 19761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:29.064865 19762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:29.065092 19756 server_base.cc:1034] running on GCE node
I20260929 06:38:29.065285 19756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:29.065502 19756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:29.066632 19756 hybrid_clock.cc:648] HybridClock initialized: now 1790663909066619 us; error 27 us; skew 500 ppm
Sep 29 06:38:29 dist-test-slave-ltw5 krb5kdc[19515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663909, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:29.069013 19756 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:38:29.069427 19756 webserver.cc:460] Webserver started at http://127.15.157.130:46275/ using document root <none> and password file <none>
I20260929 06:38:29.069613 19756 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:29.069651 19756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:29.069739 19756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:29.070851 19756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "8ee57c4fc6c84f9c8f4d34af299c331b"
format_stamp: "Formatted at 2026-09-29 06:38:29 on dist-test-slave-ltw5"
server_key: "51c861ec77a094ab66d64c48d17e493e"
server_key_iv: "52f67c0b73355c208c0a63204af729ea"
server_key_version: "encryptionkey@0"
I20260929 06:38:29.071138 19756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "8ee57c4fc6c84f9c8f4d34af299c331b"
format_stamp: "Formatted at 2026-09-29 06:38:29 on dist-test-slave-ltw5"
server_key: "51c861ec77a094ab66d64c48d17e493e"
server_key_iv: "52f67c0b73355c208c0a63204af729ea"
server_key_version: "encryptionkey@0"
I20260929 06:38:29.072371 19756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:29.073028 19771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:29.073249 19756 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:29.073330 19756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "8ee57c4fc6c84f9c8f4d34af299c331b"
format_stamp: "Formatted at 2026-09-29 06:38:29 on dist-test-slave-ltw5"
server_key: "51c861ec77a094ab66d64c48d17e493e"
server_key_iv: "52f67c0b73355c208c0a63204af729ea"
server_key_version: "encryptionkey@0"
I20260929 06:38:29.073385 19756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:29.093021 19756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:29.094825 19756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:29.094938 19756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:29.095118 19756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:29.095373 19756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:29.095402 19756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:29.095425 19756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:29.095438 19756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:29.100905 19756 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:43897
I20260929 06:38:29.100975 19884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:43897 every 8 connection(s)
I20260929 06:38:29.101284 19756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:38:29 dist-test-slave-ltw5 krb5kdc[19515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663909, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:29.109934 19599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:29.101975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:58571 (local address 127.15.157.190:37271)
0929 06:38:29.102071 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:29.102074 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:29.102260 (+ 186us) server_negotiation.cc:407] Connection header received
0929 06:38:29.103176 (+ 916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:29.103177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:29.103187 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:29.103243 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:29.103845 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:29.104335 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:29.105263 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:29.105436 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:29.105485 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:29.107526 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:29.107527 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:29.107528 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:29.107534 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:29.108840 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:29.109185 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:29.109185 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:29.109186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:29.109237 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:29.109441 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:29.109442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:29.109442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:29.109542 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:29.109591 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:29.109802 (+ 211us) server_negotiation.cc:299] Negotiation successful
0929 06:38:29.109867 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260929 06:38:29.110111 19887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:29.101937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:37271 (local address 127.15.157.130:58571)
0929 06:38:29.102127 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:29.102161 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:29.103088 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:29.103295 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:29.103298 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:29.103541 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:29.103740 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:29.103744 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:29.104411 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:29.104412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:29.105197 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:29.105199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:29.105501 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:29.105502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:29.105602 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:29.106105 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:29.106115 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:29.107444 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:29.108912 (+ 1468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:29.108918 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:29.108920 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:29.109123 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:29.109289 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:29.109289 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:29.109290 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:29.109389 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:29.109592 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:29.109595 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:29.109700 (+ 105us) client_negotiation.cc:769] Sending connection context
0929 06:38:29.109778 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 06:38:29.109892 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":127,"threads_started":1}
I20260929 06:38:29.110569 19885 heartbeater.cc:347] Connected to a master server at 127.15.157.190:37271
I20260929 06:38:29.110668 19885 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:29.110837 19885 heartbeater.cc:511] Master 127.15.157.190:37271 requested a full tablet report, sending...
I20260929 06:38:29.111231 19560 ts_manager.cc:194] Registered new tserver with Master: 8ee57c4fc6c84f9c8f4d34af299c331b (127.15.157.130:43897)
I20260929 06:38:29.111261 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 19756
I20260929 06:38:29.111371 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:38:29.111606 15990 external_mini_cluster.cc:1428] Setting key 7be24bc65d8abe814cfc6662fb546314
I20260929 06:38:29.111691 19560 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:58571
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:38:29.137012 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:37271
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:46673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:29.217218 19890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:29.217407 19890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:29.217429 19890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:29.218498 19890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:29.218531 19890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:29.218557 19890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:29.219935 19890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:46673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:37271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:29.220104 19890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:29.220266 19890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:29.225121 19896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:29.225124 19898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:29.225157 19890 server_base.cc:1034] running on GCE node
W20260929 06:38:29.225126 19895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:29.225495 19890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:29.225735 19890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:29.226893 19890 hybrid_clock.cc:648] HybridClock initialized: now 1790663909226895 us; error 40 us; skew 500 ppm
Sep 29 06:38:29 dist-test-slave-ltw5 krb5kdc[19515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663909, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:29.229200 19890 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:38:29.229586 19890 webserver.cc:460] Webserver started at http://127.15.157.131:34379/ using document root <none> and password file <none>
I20260929 06:38:29.229810 19890 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:29.229873 19890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:29.230010 19890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:29.231029 19890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "5fbf51f5a28448ab8ca9819090c5237f"
format_stamp: "Formatted at 2026-09-29 06:38:29 on dist-test-slave-ltw5"
server_key: "0e21c5020b428575df17095a2f5cea77"
server_key_iv: "23f2da106778a59248eec33376ef91ea"
server_key_version: "encryptionkey@0"
I20260929 06:38:29.231367 19890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "5fbf51f5a28448ab8ca9819090c5237f"
format_stamp: "Formatted at 2026-09-29 06:38:29 on dist-test-slave-ltw5"
server_key: "0e21c5020b428575df17095a2f5cea77"
server_key_iv: "23f2da106778a59248eec33376ef91ea"
server_key_version: "encryptionkey@0"
I20260929 06:38:29.232612 19890 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:29.233275 19905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:29.233433 19890 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:29.233520 19890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "5fbf51f5a28448ab8ca9819090c5237f"
format_stamp: "Formatted at 2026-09-29 06:38:29 on dist-test-slave-ltw5"
server_key: "0e21c5020b428575df17095a2f5cea77"
server_key_iv: "23f2da106778a59248eec33376ef91ea"
server_key_version: "encryptionkey@0"
I20260929 06:38:29.233590 19890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:29.247301 19890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:29.248955 19890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:29.249107 19890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:29.249331 19890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:29.249617 19890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:29.249667 19890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:29.249701 19890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:29.249728 19890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:29.255148 19890 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:42331
I20260929 06:38:29.255196 20018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:42331 every 8 connection(s)
I20260929 06:38:29.255481 19890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:38:29 dist-test-slave-ltw5 krb5kdc[19515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663909, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:29.261523 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 19890
I20260929 06:38:29.261626 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:38:29.261833 15990 external_mini_cluster.cc:1428] Setting key 240bef282168af5ff53d23700576c05d
I20260929 06:38:29.264312 19599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:29.256141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:36071 (local address 127.15.157.190:37271)
0929 06:38:29.256202 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:29.256204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:29.256406 (+ 202us) server_negotiation.cc:407] Connection header received
0929 06:38:29.257289 (+ 883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:29.257290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:29.257299 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:29.257358 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:29.257925 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:29.258481 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:29.259462 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:29.259639 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:29.259685 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:29.261754 (+ 2069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:29.261756 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:29.261756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:29.261764 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:29.263236 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:29.263589 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:29.263590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:29.263590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:29.263639 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:29.263830 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:29.263830 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:29.263831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:29.263932 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:29.263981 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:29.264184 (+ 203us) server_negotiation.cc:299] Negotiation successful
0929 06:38:29.264239 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 06:38:29.264469 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:29.256092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:37271 (local address 127.15.157.131:36071)
0929 06:38:29.256269 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:29.256309 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:29.257194 (+ 885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:29.257422 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:29.257425 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:29.257677 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:29.257853 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:29.257858 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:29.258583 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:29.258584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:29.259383 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:29.259384 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:29.259701 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:29.259702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:29.259794 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:29.260309 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:29.260318 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:29.261672 (+ 1354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:29.263310 (+ 1638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:29.263316 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:29.263318 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:29.263528 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:29.263690 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:29.263690 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:29.263691 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:29.263781 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:29.263980 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:29.263984 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:29.264085 (+ 101us) client_negotiation.cc:769] Sending connection context
0929 06:38:29.264163 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 06:38:29.264273 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":95,"threads_started":1}
I20260929 06:38:29.264891 20019 heartbeater.cc:347] Connected to a master server at 127.15.157.190:37271
I20260929 06:38:29.264986 20019 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:29.265149 20019 heartbeater.cc:511] Master 127.15.157.190:37271 requested a full tablet report, sending...
I20260929 06:38:29.265472 19560 ts_manager.cc:194] Registered new tserver with Master: 5fbf51f5a28448ab8ca9819090c5237f (127.15.157.131:42331)
I20260929 06:38:29.265834 19560 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:36071
I20260929 06:38:29.273535 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 06:38:29 dist-test-slave-ltw5 krb5kdc[19515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 06:38:29 dist-test-slave-ltw5 krb5kdc[19515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.129@KRBTEST.COM
I20260929 06:38:29.296325 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:29.288667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40914 (local address 127.15.157.129:33549)
0929 06:38:29.288853 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:29.288858 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:29.288874 (+ 16us) server_negotiation.cc:407] Connection header received
0929 06:38:29.288902 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:29.288905 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:29.288938 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:29.289012 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:29.289525 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:29.290386 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:29.291099 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:29.291434 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:29.291497 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:29.293736 (+ 2239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:29.293743 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:29.293743 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:29.293749 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:29.295379 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:29.295683 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:29.295698 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:29.295698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:29.295765 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:29.295908 (+ 143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:29.295908 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:29.295909 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:29.296023 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:29.296119 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:29.296182 (+ 63us) server_negotiation.cc:299] Negotiation successful
0929 06:38:29.296242 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":91,"threads_started":1}
Sep 29 06:38:29 dist-test-slave-ltw5 krb5kdc[19515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:29.304138 19599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:29.297568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44728 (local address 127.15.157.190:37271)
0929 06:38:29.297607 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:29.297608 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:29.297651 (+ 43us) server_negotiation.cc:407] Connection header received
0929 06:38:29.297716 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:29.297716 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:29.297725 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:29.297771 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:29.298290 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:29.298749 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:29.299400 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:29.299570 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:29.299617 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:29.301811 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:29.301813 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:29.301813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:29.301821 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:29.302979 (+ 1158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:29.303346 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:29.303347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:29.303348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:29.303400 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:29.303582 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:29.303583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:29.303583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:29.303723 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:29.303853 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:29.303957 (+ 104us) server_negotiation.cc:299] Negotiation successful
0929 06:38:29.304034 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260929 06:38:29.304371 19560 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44728
I20260929 06:38:29.304704 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 19622
I20260929 06:38:29.309628 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 19756
I20260929 06:38:29.313712 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 19890
I20260929 06:38:29.317528 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 19528
2026-09-29T06:38:29Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1835 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:29 dist-test-slave-ltw5 krb5kdc[20031](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:29 dist-test-slave-ltw5 krb5kdc[20031](info): set up 2 sockets
Sep 29 06:38:29 dist-test-slave-ltw5 krb5kdc[20031](info): commencing operation
krb5kdc: starting...
W20260929 06:38:30.361920 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:38:30 dist-test-slave-ltw5 krb5kdc[20031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:38:30.472880 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45397
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:45397
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:30.557550 20044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:30.557760 20044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:30.557782 20044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:30.558995 20044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:30.559036 20044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:30.559051 20044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:30.559063 20044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:30.559103 20044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:30.560577 20044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:45397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:30.560835 20044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:30.561060 20044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:30.565912 20049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:30.565899 20050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:30.565899 20052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:30.566234 20044 server_base.cc:1034] running on GCE node
I20260929 06:38:30.566486 20044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:30.566802 20044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:30.567952 20044 hybrid_clock.cc:648] HybridClock initialized: now 1790663910567941 us; error 27 us; skew 500 ppm
Sep 29 06:38:30 dist-test-slave-ltw5 krb5kdc[20031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663910, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:30.570384 20044 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:38:30.570752 20044 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:30.570801 20044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:30.570950 20044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:30.571973 20044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "904a4c00fd6d4489ae05710621bfc723"
format_stamp: "Formatted at 2026-09-29 06:38:30 on dist-test-slave-ltw5"
server_key: "d9895289217751ac4e3d6c81653c88fa"
server_key_iv: "b8ab0e81fc2ff1fc9445645b9e14d6b5"
server_key_version: "encryptionkey@0"
I20260929 06:38:30.572332 20044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "904a4c00fd6d4489ae05710621bfc723"
format_stamp: "Formatted at 2026-09-29 06:38:30 on dist-test-slave-ltw5"
server_key: "d9895289217751ac4e3d6c81653c88fa"
server_key_iv: "b8ab0e81fc2ff1fc9445645b9e14d6b5"
server_key_version: "encryptionkey@0"
I20260929 06:38:30.573576 20044 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:38:30.574309 20058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:30.574501 20044 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:30.574570 20044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "904a4c00fd6d4489ae05710621bfc723"
format_stamp: "Formatted at 2026-09-29 06:38:30 on dist-test-slave-ltw5"
server_key: "d9895289217751ac4e3d6c81653c88fa"
server_key_iv: "b8ab0e81fc2ff1fc9445645b9e14d6b5"
server_key_version: "encryptionkey@0"
I20260929 06:38:30.574657 20044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:30.604051 20044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:30.606465 20044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:30.606629 20044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:30.610440 20044 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:45397
I20260929 06:38:30.610467 20110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:45397 every 8 connection(s)
I20260929 06:38:30.610752 20044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:30.611682 20111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:30.613965 20111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723: Bootstrap starting.
I20260929 06:38:30.614599 20111 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:30.614902 20111 log.cc:824] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:30.615566 20111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723: No bootstrap required, opened a new log
I20260929 06:38:30.617112 20111 raft_consensus.cc:348] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "904a4c00fd6d4489ae05710621bfc723" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45397 } }
I20260929 06:38:30.617245 20111 raft_consensus.cc:374] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:30.617270 20111 raft_consensus.cc:729] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904a4c00fd6d4489ae05710621bfc723, State: Initialized, Role: FOLLOWER
I20260929 06:38:30.617460 20111 consensus_queue.cc:260] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "904a4c00fd6d4489ae05710621bfc723" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45397 } }
I20260929 06:38:30.617522 20111 raft_consensus.cc:388] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:30.617563 20111 raft_consensus.cc:482] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:30.617556 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 20044
I20260929 06:38:30.617612 20111 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:30.617697 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:30.617918 15990 external_mini_cluster.cc:1428] Setting key f3a378a30b5d7b86641746ab4f16a2d0
I20260929 06:38:30.618746 20111 raft_consensus.cc:504] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "904a4c00fd6d4489ae05710621bfc723" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45397 } }
I20260929 06:38:30.618862 20111 leader_election.cc:302] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 904a4c00fd6d4489ae05710621bfc723; no voters:
I20260929 06:38:30.619004 20111 leader_election.cc:288] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:30.619053 20116 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:30.619241 20111 sys_catalog.cc:564] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:30.619227 20116 raft_consensus.cc:686] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [term 1 LEADER]: Becoming Leader. State: Replica: 904a4c00fd6d4489ae05710621bfc723, State: Running, Role: LEADER
I20260929 06:38:30.619477 20116 consensus_queue.cc:237] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "904a4c00fd6d4489ae05710621bfc723" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45397 } }
I20260929 06:38:30.619902 20117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "904a4c00fd6d4489ae05710621bfc723" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "904a4c00fd6d4489ae05710621bfc723" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45397 } } }
I20260929 06:38:30.619894 20118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 904a4c00fd6d4489ae05710621bfc723. Latest consensus state: current_term: 1 leader_uuid: "904a4c00fd6d4489ae05710621bfc723" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "904a4c00fd6d4489ae05710621bfc723" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45397 } } }
I20260929 06:38:30.619982 20117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:30.619984 20118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:30.620174 20125 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:30.620698 20125 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:30.622140 20125 catalog_manager.cc:1347] Generated new cluster ID: 51390800cf1441b5815df990ac7e9327
I20260929 06:38:30.622195 20125 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:38:30 dist-test-slave-ltw5 krb5kdc[20031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:30.629340 20115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:30.618571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47268 (local address 127.15.157.190:45397)
0929 06:38:30.618783 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:30.618793 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:30.618829 (+ 36us) server_negotiation.cc:407] Connection header received
0929 06:38:30.618946 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:30.618953 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:30.619012 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:30.619159 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:30.620065 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:30.621636 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:30.622598 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:30.623143 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:30.623320 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:30.625630 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:30.625633 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:30.625633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:30.625645 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:30.627837 (+ 2192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:30.628243 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:30.628246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:30.628247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:30.628338 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:30.628546 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:30.628547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:30.628548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:30.628792 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:30.628968 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:30.629034 (+ 66us) server_negotiation.cc:299] Negotiation successful
0929 06:38:30.629167 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":100,"threads_started":1}
I20260929 06:38:30.632872 20125 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:30.633432 20125 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:30.649190 20125 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723: Generated new TSK 0
I20260929 06:38:30.649407 20125 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:38:30.682582 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45397
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:30.783789 20137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:30.783987 20137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:30.784013 20137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:30.785089 20137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:30.785122 20137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:30.785148 20137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:30.786617 20137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:30.787030 20137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:30.787298 20137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:30.792155 20142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:30.792135 20145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:30.792344 20137 server_base.cc:1034] running on GCE node
W20260929 06:38:30.792183 20143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:30.792613 20137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:30.792810 20137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:30.794059 20137 hybrid_clock.cc:648] HybridClock initialized: now 1790663910794004 us; error 24 us; skew 500 ppm
Sep 29 06:38:30 dist-test-slave-ltw5 krb5kdc[20031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663910, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:30.796592 20137 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:38:30.797005 20137 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:30.797078 20137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:30.797217 20137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:30.798403 20137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84"
format_stamp: "Formatted at 2026-09-29 06:38:30 on dist-test-slave-ltw5"
server_key: "6012fb988eb8abe3ef99e7395d813967"
server_key_iv: "ce6a223daa2d914e2a6651184a38a93f"
server_key_version: "encryptionkey@0"
I20260929 06:38:30.798764 20137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84"
format_stamp: "Formatted at 2026-09-29 06:38:30 on dist-test-slave-ltw5"
server_key: "6012fb988eb8abe3ef99e7395d813967"
server_key_iv: "ce6a223daa2d914e2a6651184a38a93f"
server_key_version: "encryptionkey@0"
I20260929 06:38:30.800032 20137 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:30.800751 20151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:30.800909 20137 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:30.801004 20137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84"
format_stamp: "Formatted at 2026-09-29 06:38:30 on dist-test-slave-ltw5"
server_key: "6012fb988eb8abe3ef99e7395d813967"
server_key_iv: "ce6a223daa2d914e2a6651184a38a93f"
server_key_version: "encryptionkey@0"
I20260929 06:38:30.801083 20137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:30.818629 20137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:30.820652 20137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:30.820816 20137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:30.821039 20137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:30.821362 20137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:30.821419 20137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:30.821460 20137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:30.821487 20137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:30.827169 20137 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:37721
I20260929 06:38:30.827206 20264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:37721 every 8 connection(s)
I20260929 06:38:30.827463 20137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:38:30.827903 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 20137
I20260929 06:38:30.828011 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:38:30.828150 15990 external_mini_cluster.cc:1428] Setting key 4a38d1b2a49281c9c5b3cd1377ab134d
Sep 29 06:38:30 dist-test-slave-ltw5 krb5kdc[20031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663910, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
I20260929 06:38:30.837941 20115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:30.828714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:33531 (local address 127.15.157.190:45397)
0929 06:38:30.828778 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:30.828780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:30.829011 (+ 231us) server_negotiation.cc:407] Connection header received
0929 06:38:30.829756 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:30.829756 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:30.829765 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:30.829807 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:30.830955 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:30.831452 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:30.832520 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:30.832725 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:30.832836 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:30.835258 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:30.835259 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:30.835260 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:30.835269 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:30.836729 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:30.837112 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:30.837113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:30.837113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:30.837177 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:30.837416 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:30.837417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:30.837417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:30.837526 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:30.837579 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:30.837812 (+ 233us) server_negotiation.cc:299] Negotiation successful
0929 06:38:30.837876 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 06:38:30.838145 20267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:30.828698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45397 (local address 127.15.157.129:33531)
0929 06:38:30.828872 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:30.828920 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:30.829661 (+ 741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:30.829881 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:30.829885 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:30.830316 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:30.830855 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:30.830860 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:30.831552 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:30.831553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:30.832434 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:30.832436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:30.832844 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:30.832845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:30.832969 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:30.833507 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:30.833515 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:30.835165 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:30.836800 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:30.836805 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:30.836807 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:30.837015 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:30.837242 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:30.837243 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:30.837243 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:30.837354 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:30.837584 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:30.837588 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:30.837697 (+ 109us) client_negotiation.cc:769] Sending connection context
0929 06:38:30.837778 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 06:38:30.837903 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
I20260929 06:38:30.838660 20265 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45397
I20260929 06:38:30.838763 20265 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:30.838907 20265 heartbeater.cc:511] Master 127.15.157.190:45397 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
I20260929 06:38:30.839411 20075 ts_manager.cc:194] Registered new tserver with Master: dc9f1cb3d3d945b2adb3cc72dad96c84 (127.15.157.129:37721)
I20260929 06:38:30.840019 20075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:33531
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:38:30.854625 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45397
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:30.934480 20270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:30.934665 20270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:30.934687 20270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:30.935768 20270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:30.935802 20270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:30.935828 20270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:30.937311 20270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:30.937533 20270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:30.937708 20270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:30.942478 20275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:30.942456 20276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:30.942564 20270 server_base.cc:1034] running on GCE node
W20260929 06:38:30.942456 20278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:30.942853 20270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:30.943037 20270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:30.944190 20270 hybrid_clock.cc:648] HybridClock initialized: now 1790663910944173 us; error 29 us; skew 500 ppm
Sep 29 06:38:30 dist-test-slave-ltw5 krb5kdc[20031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663910, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:30.946588 20270 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:38:30.946910 20270 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:30.946977 20270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:30.947119 20270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:30.948096 20270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "ddd332fb2f0945e8a3229c93b800928e"
format_stamp: "Formatted at 2026-09-29 06:38:30 on dist-test-slave-ltw5"
server_key: "ad5bffbfa84d5949c59736fc1f52f9d3"
server_key_iv: "df99b8d6ec6f29ecea5a1c706ccb6140"
server_key_version: "encryptionkey@0"
I20260929 06:38:30.948432 20270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "ddd332fb2f0945e8a3229c93b800928e"
format_stamp: "Formatted at 2026-09-29 06:38:30 on dist-test-slave-ltw5"
server_key: "ad5bffbfa84d5949c59736fc1f52f9d3"
server_key_iv: "df99b8d6ec6f29ecea5a1c706ccb6140"
server_key_version: "encryptionkey@0"
I20260929 06:38:30.949630 20270 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:30.950327 20284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:30.950484 20270 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:30.950582 20270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "ddd332fb2f0945e8a3229c93b800928e"
format_stamp: "Formatted at 2026-09-29 06:38:30 on dist-test-slave-ltw5"
server_key: "ad5bffbfa84d5949c59736fc1f52f9d3"
server_key_iv: "df99b8d6ec6f29ecea5a1c706ccb6140"
server_key_version: "encryptionkey@0"
I20260929 06:38:30.950652 20270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:30.973259 20270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:30.975174 20270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:30.975346 20270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:30.975579 20270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:30.975900 20270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:30.975955 20270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:30.975998 20270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:30.976025 20270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:30.981990 20270 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:37783
I20260929 06:38:30.982046 20397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:37783 every 8 connection(s)
I20260929 06:38:30.982308 20270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:38:30 dist-test-slave-ltw5 krb5kdc[20031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663910, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:30.989602 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 20270
I20260929 06:38:30.989722 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:38:30.989909 15990 external_mini_cluster.cc:1428] Setting key 8771d59582677363efbd1cd63578d3f9
I20260929 06:38:30.991078 20115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:30.983060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:53623 (local address 127.15.157.190:45397)
0929 06:38:30.983121 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:30.983123 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:30.983365 (+ 242us) server_negotiation.cc:407] Connection header received
0929 06:38:30.983806 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:30.983807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:30.983817 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:30.983868 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:30.984723 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:30.985197 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:30.986137 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:30.986324 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:30.986375 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:30.988268 (+ 1893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:30.988270 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:30.988270 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:30.988276 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:30.989558 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:30.990087 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:30.990088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:30.990089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:30.990151 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:30.990407 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:30.990408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:30.990408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:30.990524 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:30.990609 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:30.990852 (+ 243us) server_negotiation.cc:299] Negotiation successful
0929 06:38:30.990937 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260929 06:38:30.991087 20400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:30.983056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45397 (local address 127.15.157.130:53623)
0929 06:38:30.983235 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:30.983271 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:30.983730 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:30.983922 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:30.983925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:30.984170 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:30.984655 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:30.984659 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:30.985270 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:30.985271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:30.986066 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:30.986068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:30.986392 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:30.986392 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:30.986487 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:30.986887 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:30.986895 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:30.988183 (+ 1288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:30.989638 (+ 1455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:30.989643 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:30.989644 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:30.989930 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:30.990234 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:30.990234 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:30.990235 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:30.990341 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:30.990615 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:30.990620 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:30.990727 (+ 107us) client_negotiation.cc:769] Sending connection context
0929 06:38:30.990812 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 06:38:30.990934 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":103,"threads_started":1}
I20260929 06:38:30.991518 20398 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45397
I20260929 06:38:30.991605 20398 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:30.991763 20398 heartbeater.cc:511] Master 127.15.157.190:45397 requested a full tablet report, sending...
I20260929 06:38:30.992173 20075 ts_manager.cc:194] Registered new tserver with Master: ddd332fb2f0945e8a3229c93b800928e (127.15.157.130:37783)
I20260929 06:38:30.992558 20075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:53623
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:38:31.014055 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45397
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:31.092764 20403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:31.092993 20403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:31.093030 20403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:31.094174 20403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:31.094244 20403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:31.094286 20403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:31.095790 20403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20403
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:31.096055 20403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:31.096271 20403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:31.101059 20408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:31.101109 20403 server_base.cc:1034] running on GCE node
W20260929 06:38:31.101109 20409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:31.101054 20411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:31.101523 20403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:31.101758 20403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:31.102916 20403 hybrid_clock.cc:648] HybridClock initialized: now 1790663911102913 us; error 37 us; skew 500 ppm
Sep 29 06:38:31 dist-test-slave-ltw5 krb5kdc[20031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663911, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:31.105290 20403 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:38:31.105609 20403 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:31.105680 20403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:31.105830 20403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:31.106865 20403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "e63c0e0ed8df4359bdd4876eef15c6cd"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "09f3c7ad1fa91b5705365ceef180871d"
server_key_iv: "3146de540558b77b86b8382bd98da0f5"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.107211 20403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "e63c0e0ed8df4359bdd4876eef15c6cd"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "09f3c7ad1fa91b5705365ceef180871d"
server_key_iv: "3146de540558b77b86b8382bd98da0f5"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.108520 20403 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:31.109164 20417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:31.109311 20403 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:31.109405 20403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "e63c0e0ed8df4359bdd4876eef15c6cd"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "09f3c7ad1fa91b5705365ceef180871d"
server_key_iv: "3146de540558b77b86b8382bd98da0f5"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.109480 20403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:31.132557 20403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:31.134500 20403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:31.134663 20403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:31.134907 20403 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:31.135228 20403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:31.135305 20403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:31.135352 20403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:31.135380 20403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:31.141538 20403 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:44273
I20260929 06:38:31.141599 20530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:44273 every 8 connection(s)
I20260929 06:38:31.141875 20403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:38:31 dist-test-slave-ltw5 krb5kdc[20031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663911, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:31.148386 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 20403
I20260929 06:38:31.148469 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:38:31.148680 15990 external_mini_cluster.cc:1428] Setting key 23d9ed873583317d2f1c76c4dbaaad37
I20260929 06:38:31.151213 20115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.142642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:34665 (local address 127.15.157.190:45397)
0929 06:38:31.142696 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.142698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.142906 (+ 208us) server_negotiation.cc:407] Connection header received
0929 06:38:31.143424 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.143425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.143437 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.143493 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:31.144429 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.144926 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.145920 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.146184 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.146265 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:31.148333 (+ 2068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:31.148335 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:31.148335 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:31.148343 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:31.150183 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:31.150537 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:31.150538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:31.150538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:31.150589 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:31.150750 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:31.150750 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:31.150750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:31.150841 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:31.150884 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.151090 (+ 206us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.151150 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 06:38:31.151376 20533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.142629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45397 (local address 127.15.157.131:34665)
0929 06:38:31.142793 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:31.142830 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:31.143317 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:31.143564 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:31.143568 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:31.143834 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:31.144313 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:31.144326 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.145014 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.145015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:31.145818 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:31.145820 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.146274 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.146275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:31.146404 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:31.146927 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:31.146935 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:31.148239 (+ 1304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:31.150245 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:31.150250 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:31.150251 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:31.150472 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:31.150627 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:31.150628 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:31.150628 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:31.150714 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:31.150875 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:31.150877 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:31.150985 (+ 108us) client_negotiation.cc:769] Sending connection context
0929 06:38:31.151061 (+ 76us) client_negotiation.cc:240] Negotiation successful
0929 06:38:31.151172 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":82,"threads_started":1}
I20260929 06:38:31.151830 20531 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45397
I20260929 06:38:31.151937 20531 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:31.152081 20531 heartbeater.cc:511] Master 127.15.157.190:45397 requested a full tablet report, sending...
I20260929 06:38:31.152411 20075 ts_manager.cc:194] Registered new tserver with Master: e63c0e0ed8df4359bdd4876eef15c6cd (127.15.157.131:44273)
I20260929 06:38:31.152727 20075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:34665
I20260929 06:38:31.160845 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:38:31.167910 20115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.162128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47282 (local address 127.15.157.190:45397)
0929 06:38:31.162196 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.162198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.162328 (+ 130us) server_negotiation.cc:407] Connection header received
0929 06:38:31.162353 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.162353 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.162363 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.162420 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:31.162951 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.163440 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.164126 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.164320 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.164376 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:31.165447 (+ 1071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:31.165448 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:31.165448 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:31.165453 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:31.166928 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:31.167225 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:31.167226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:31.167226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:31.167281 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:31.167452 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:31.167452 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:31.167453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:31.167589 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:31.167660 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.167741 (+ 81us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.167796 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:38:31.169628 20075 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47282:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:38:31.172137 20075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:31.178799 20543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.174418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:44273 (local address 127.0.0.1:53324)
0929 06:38:31.174555 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:31.174599 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:31.174665 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:31.175066 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:31.175070 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:31.175072 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:31.175137 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:31.175138 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.176453 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.176454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:31.177602 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:31.177604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.178470 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.178470 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:31.178560 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:31.178574 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 06:38:31.178663 (+ 89us) client_negotiation.cc:240] Negotiation successful
0929 06:38:31.178718 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":81,"threads_started":1}
I20260929 06:38:31.178881 20547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.174894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34984 (local address 127.15.157.130:37783)
0929 06:38:31.175435 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.175439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.175448 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:31.175484 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.175486 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.175500 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.175568 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:31.175773 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.176703 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.177849 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.178567 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.178634 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:31.178683 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.178762 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.178800 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":95,"threads_started":1}
I20260929 06:38:31.178844 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.174526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55832 (local address 127.15.157.129:37721)
0929 06:38:31.175142 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.175146 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.175155 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:31.175212 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.175214 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.175228 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.175304 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:31.175427 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.176117 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.177593 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.178387 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.178459 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:31.178513 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.178709 (+ 196us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.178755 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":91,"threads_started":1}
I20260929 06:38:31.179114 20546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.174664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53324 (local address 127.15.157.131:44273)
0929 06:38:31.174859 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.174864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.174875 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:38:31.174917 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.174920 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.174936 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.175013 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:31.175213 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.176342 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.177664 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.178377 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.178470 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:31.178522 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.178992 (+ 470us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.179034 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":73,"threads_started":1}
I20260929 06:38:31.179203 20545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.174418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:37721 (local address 127.0.0.1:55832)
0929 06:38:31.174800 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:31.174815 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:31.174878 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:31.175300 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:31.175301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:31.175303 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:31.175345 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:31.175346 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.176216 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.176216 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:31.177509 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:31.177511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.178547 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.178548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:31.178614 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:31.178619 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:38:31.179076 (+ 457us) client_negotiation.cc:240] Negotiation successful
0929 06:38:31.179122 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"mutex_wait_us":2,"thread_start_us":56,"threads_started":1}
I20260929 06:38:31.179360 20542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.174654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:37783 (local address 127.0.0.1:34984)
0929 06:38:31.174870 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:31.174879 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:31.174931 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:31.175663 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:31.175664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:31.175666 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:31.175703 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:31.175704 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.176799 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.176816 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:31.177755 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:31.177758 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.178645 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.178645 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:31.178700 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:31.178703 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:38:31.178754 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 06:38:31.178793 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":80,"threads_started":1}
I20260929 06:38:31.179824 20465 tablet_service.cc:1467] Processing CreateTablet for tablet 3c078b95f2d34b9fb531fa02ac12f4b6 (DEFAULT_TABLE table=test-table [id=cd7c096fe6c944b5be52f594b3e18d46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:31.179978 20199 tablet_service.cc:1467] Processing CreateTablet for tablet 3c078b95f2d34b9fb531fa02ac12f4b6 (DEFAULT_TABLE table=test-table [id=cd7c096fe6c944b5be52f594b3e18d46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:31.180167 20465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c078b95f2d34b9fb531fa02ac12f4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:31.180336 20199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c078b95f2d34b9fb531fa02ac12f4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:31.182729 20548 tablet_bootstrap.cc:492] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd: Bootstrap starting.
I20260929 06:38:31.182909 20549 tablet_bootstrap.cc:492] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84: Bootstrap starting.
I20260929 06:38:31.183405 20548 tablet_bootstrap.cc:654] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:31.183485 20549 tablet_bootstrap.cc:654] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:31.183465 20332 tablet_service.cc:1467] Processing CreateTablet for tablet 3c078b95f2d34b9fb531fa02ac12f4b6 (DEFAULT_TABLE table=test-table [id=cd7c096fe6c944b5be52f594b3e18d46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:31.183804 20332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c078b95f2d34b9fb531fa02ac12f4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:31.184002 20548 log.cc:824] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:31.184026 20549 log.cc:824] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:31.184695 20548 tablet_bootstrap.cc:492] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd: No bootstrap required, opened a new log
I20260929 06:38:31.184751 20549 tablet_bootstrap.cc:492] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84: No bootstrap required, opened a new log
I20260929 06:38:31.184785 20548 ts_tablet_manager.cc:1397] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:38:31.184805 20549 ts_tablet_manager.cc:1397] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:38:31.186153 20548 raft_consensus.cc:348] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37721 } } peers { permanent_uuid: "ddd332fb2f0945e8a3229c93b800928e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37783 } } peers { permanent_uuid: "e63c0e0ed8df4359bdd4876eef15c6cd" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44273 } }
I20260929 06:38:31.186295 20548 raft_consensus.cc:374] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:31.186336 20548 raft_consensus.cc:729] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e63c0e0ed8df4359bdd4876eef15c6cd, State: Initialized, Role: FOLLOWER
I20260929 06:38:31.186447 20548 consensus_queue.cc:260] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37721 } } peers { permanent_uuid: "ddd332fb2f0945e8a3229c93b800928e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37783 } } peers { permanent_uuid: "e63c0e0ed8df4359bdd4876eef15c6cd" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44273 } }
I20260929 06:38:31.186722 20531 heartbeater.cc:503] Master 127.15.157.190:45397 was elected leader, sending a full tablet report...
I20260929 06:38:31.186789 20549 raft_consensus.cc:348] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37721 } } peers { permanent_uuid: "ddd332fb2f0945e8a3229c93b800928e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37783 } } peers { permanent_uuid: "e63c0e0ed8df4359bdd4876eef15c6cd" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44273 } }
I20260929 06:38:31.186959 20549 raft_consensus.cc:374] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:31.186992 20549 raft_consensus.cc:729] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc9f1cb3d3d945b2adb3cc72dad96c84, State: Initialized, Role: FOLLOWER
I20260929 06:38:31.186726 20548 ts_tablet_manager.cc:1428] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:38:31.187106 20549 consensus_queue.cc:260] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37721 } } peers { permanent_uuid: "ddd332fb2f0945e8a3229c93b800928e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37783 } } peers { permanent_uuid: "e63c0e0ed8df4359bdd4876eef15c6cd" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44273 } }
I20260929 06:38:31.187314 20553 tablet_bootstrap.cc:492] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e: Bootstrap starting.
I20260929 06:38:31.187381 20549 ts_tablet_manager.cc:1428] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:38:31.187484 20265 heartbeater.cc:503] Master 127.15.157.190:45397 was elected leader, sending a full tablet report...
I20260929 06:38:31.187877 20553 tablet_bootstrap.cc:654] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:31.188357 20553 log.cc:824] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:31.189019 20553 tablet_bootstrap.cc:492] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e: No bootstrap required, opened a new log
I20260929 06:38:31.189093 20553 ts_tablet_manager.cc:1397] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:38:31.190429 20553 raft_consensus.cc:348] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37721 } } peers { permanent_uuid: "ddd332fb2f0945e8a3229c93b800928e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37783 } } peers { permanent_uuid: "e63c0e0ed8df4359bdd4876eef15c6cd" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44273 } }
I20260929 06:38:31.190572 20553 raft_consensus.cc:374] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:31.190615 20553 raft_consensus.cc:729] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddd332fb2f0945e8a3229c93b800928e, State: Initialized, Role: FOLLOWER
I20260929 06:38:31.190745 20553 consensus_queue.cc:260] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37721 } } peers { permanent_uuid: "ddd332fb2f0945e8a3229c93b800928e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37783 } } peers { permanent_uuid: "e63c0e0ed8df4359bdd4876eef15c6cd" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44273 } }
I20260929 06:38:31.190994 20553 ts_tablet_manager.cc:1428] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:38:31.191032 20398 heartbeater.cc:503] Master 127.15.157.190:45397 was elected leader, sending a full tablet report...
W20260929 06:38:31.232836 20399 tablet.cc:2369] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:38:31.328169 20266 tablet.cc:2369] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:38:31.379879 20554 raft_consensus.cc:482] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:31.380005 20554 raft_consensus.cc:504] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37721 } } peers { permanent_uuid: "ddd332fb2f0945e8a3229c93b800928e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37783 } } peers { permanent_uuid: "e63c0e0ed8df4359bdd4876eef15c6cd" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44273 } }
I20260929 06:38:31.380344 20554 leader_election.cc:288] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddd332fb2f0945e8a3229c93b800928e (127.15.157.130:37783), e63c0e0ed8df4359bdd4876eef15c6cd (127.15.157.131:44273)
I20260929 06:38:31.383687 20546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.380672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:40099 (local address 127.15.157.131:44273)
0929 06:38:31.380730 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.380733 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.380878 (+ 145us) server_negotiation.cc:407] Connection header received
0929 06:38:31.380941 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.380942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.380969 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.381025 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:31.381237 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.381682 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.382945 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.383311 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.383369 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:31.383375 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.383562 (+ 187us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.383606 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 06:38:31.383703 20547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.380655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:42025 (local address 127.15.157.130:37783)
0929 06:38:31.380713 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.380716 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.380848 (+ 132us) server_negotiation.cc:407] Connection header received
0929 06:38:31.380901 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.380902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.380913 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.380976 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:31.381157 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.381795 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.382891 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.383335 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.383435 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:31.383443 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.383594 (+ 151us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.383631 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 06:38:31.383708 20558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.380581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:37783 (local address 127.15.157.129:42025)
0929 06:38:31.380762 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:31.380773 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:31.380836 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:31.380997 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:31.380998 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:31.381000 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:31.381072 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:31.381074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.381896 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.381897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:31.382795 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:31.382797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.383447 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.383448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:31.383499 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:31.383502 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:38:31.383576 (+ 74us) client_negotiation.cc:240] Negotiation successful
0929 06:38:31.383614 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":120,"threads_started":1}
I20260929 06:38:31.383721 20557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.380604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:44273 (local address 127.15.157.129:40099)
0929 06:38:31.380774 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:31.380790 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:31.380877 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:31.381055 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:31.381056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:31.381058 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:31.381161 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:31.381162 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.381780 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.381781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:31.382819 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:31.382822 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.383393 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.383395 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:31.383474 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:31.383479 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:38:31.383535 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 06:38:31.383604 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":117,"thread_start_us":82,"threads_started":1}
I20260929 06:38:31.384058 20352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c078b95f2d34b9fb531fa02ac12f4b6" candidate_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd332fb2f0945e8a3229c93b800928e" is_pre_election: true
I20260929 06:38:31.384256 20352 raft_consensus.cc:2454] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc9f1cb3d3d945b2adb3cc72dad96c84 in term 0.
I20260929 06:38:31.384256 20485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c078b95f2d34b9fb531fa02ac12f4b6" candidate_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e63c0e0ed8df4359bdd4876eef15c6cd" is_pre_election: true
I20260929 06:38:31.384384 20485 raft_consensus.cc:2454] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc9f1cb3d3d945b2adb3cc72dad96c84 in term 0.
I20260929 06:38:31.384506 20155 leader_election.cc:302] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc9f1cb3d3d945b2adb3cc72dad96c84, ddd332fb2f0945e8a3229c93b800928e; no voters:
I20260929 06:38:31.384651 20554 raft_consensus.cc:2781] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:31.384708 20554 raft_consensus.cc:482] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:31.384732 20554 raft_consensus.cc:3037] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:31.385387 20554 raft_consensus.cc:504] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37721 } } peers { permanent_uuid: "ddd332fb2f0945e8a3229c93b800928e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37783 } } peers { permanent_uuid: "e63c0e0ed8df4359bdd4876eef15c6cd" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44273 } }
I20260929 06:38:31.385526 20554 leader_election.cc:288] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [CANDIDATE]: Term 1 election: Requested vote from peers ddd332fb2f0945e8a3229c93b800928e (127.15.157.130:37783), e63c0e0ed8df4359bdd4876eef15c6cd (127.15.157.131:44273)
I20260929 06:38:31.385676 20352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c078b95f2d34b9fb531fa02ac12f4b6" candidate_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddd332fb2f0945e8a3229c93b800928e"
I20260929 06:38:31.385761 20352 raft_consensus.cc:3037] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:31.385784 20485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c078b95f2d34b9fb531fa02ac12f4b6" candidate_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e63c0e0ed8df4359bdd4876eef15c6cd"
I20260929 06:38:31.385887 20485 raft_consensus.cc:3037] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:31.386598 20352 raft_consensus.cc:2454] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9f1cb3d3d945b2adb3cc72dad96c84 in term 1.
I20260929 06:38:31.386749 20485 raft_consensus.cc:2454] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9f1cb3d3d945b2adb3cc72dad96c84 in term 1.
I20260929 06:38:31.386758 20155 leader_election.cc:302] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc9f1cb3d3d945b2adb3cc72dad96c84, ddd332fb2f0945e8a3229c93b800928e; no voters:
I20260929 06:38:31.386891 20554 raft_consensus.cc:2781] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:31.387069 20554 raft_consensus.cc:686] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [term 1 LEADER]: Becoming Leader. State: Replica: dc9f1cb3d3d945b2adb3cc72dad96c84, State: Running, Role: LEADER
I20260929 06:38:31.387199 20554 consensus_queue.cc:237] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37721 } } peers { permanent_uuid: "ddd332fb2f0945e8a3229c93b800928e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37783 } } peers { permanent_uuid: "e63c0e0ed8df4359bdd4876eef15c6cd" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44273 } }
I20260929 06:38:31.388028 20075 catalog_manager.cc:5495] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc9f1cb3d3d945b2adb3cc72dad96c84 (127.15.157.129). New cstate: current_term: 1 leader_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc9f1cb3d3d945b2adb3cc72dad96c84" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddd332fb2f0945e8a3229c93b800928e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e63c0e0ed8df4359bdd4876eef15c6cd" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44273 } health_report { overall_health: UNKNOWN } } }
W20260929 06:38:31.392392 20532 tablet.cc:2369] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:38:31.407476 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.405273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55836 (local address 127.15.157.129:37721)
0929 06:38:31.405338 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.405340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.405348 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:31.405402 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.405403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.405418 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.405476 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:31.405598 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.406111 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.406803 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:31.406979 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:31.407027 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:31.407164 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:31.407259 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:31.407317 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.407357 (+ 40us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.407373 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 06:38:31.409173 20485 raft_consensus.cc:1261] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd [term 1 FOLLOWER]: Refusing update from remote peer dc9f1cb3d3d945b2adb3cc72dad96c84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:31.409227 20352 raft_consensus.cc:1261] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e [term 1 FOLLOWER]: Refusing update from remote peer dc9f1cb3d3d945b2adb3cc72dad96c84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:31.409536 20559 consensus_queue.cc:1035] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e63c0e0ed8df4359bdd4876eef15c6cd" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:31.409660 20554 consensus_queue.cc:1035] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddd332fb2f0945e8a3229c93b800928e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:31.413051 20563 mvcc.cc:205] Tried to move back new op lower bound from 7334559381129433088 to 7334559381042688000. Current Snapshot: MvccSnapshot[applied={T|T < 7334559381129433088}]
I20260929 06:38:31.414793 20074 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47282:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:31.414896 20074 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47282:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:31.415637 20074 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 904a4c00fd6d4489ae05710621bfc723: Sending DeleteTablet for 3 replicas of tablet 3c078b95f2d34b9fb531fa02ac12f4b6
I20260929 06:38:31.415930 20199 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c078b95f2d34b9fb531fa02ac12f4b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:31 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:55832
I20260929 06:38:31.415973 20332 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c078b95f2d34b9fb531fa02ac12f4b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:31 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:34984
I20260929 06:38:31.416147 20571 tablet_replica.cc:330] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84: stopping tablet replica
I20260929 06:38:31.416141 20465 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c078b95f2d34b9fb531fa02ac12f4b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:31 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:53324
I20260929 06:38:31.416297 20571 raft_consensus.cc:2229] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:38:31.416325 20573 tablet_replica.cc:330] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd: stopping tablet replica
I20260929 06:38:31.416443 20571 raft_consensus.cc:2258] T 3c078b95f2d34b9fb531fa02ac12f4b6 P dc9f1cb3d3d945b2adb3cc72dad96c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:31.416466 20573 raft_consensus.cc:2229] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:31.416527 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 20137
I20260929 06:38:31.416565 20573 raft_consensus.cc:2258] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:31.417950 20572 tablet_replica.cc:330] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e: stopping tablet replica
I20260929 06:38:31.418073 20572 raft_consensus.cc:2229] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:31.418171 20572 raft_consensus.cc:2258] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:31.419147 20572 ts_tablet_manager.cc:1905] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:31.420725 20572 ts_tablet_manager.cc:1918] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:31.420781 20572 log.cc:1196] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/3c078b95f2d34b9fb531fa02ac12f4b6
I20260929 06:38:31.421036 20572 ts_tablet_manager.cc:1939] T 3c078b95f2d34b9fb531fa02ac12f4b6 P ddd332fb2f0945e8a3229c93b800928e: Deleting consensus metadata
I20260929 06:38:31.421386 20062 catalog_manager.cc:4841] TS ddd332fb2f0945e8a3229c93b800928e (127.15.157.130:37783): tablet 3c078b95f2d34b9fb531fa02ac12f4b6 (table test-table [id=cd7c096fe6c944b5be52f594b3e18d46]) successfully deleted
W20260929 06:38:31.422068 20062 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:37721 (error 108)
I20260929 06:38:31.422344 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 20270
I20260929 06:38:31.422721 20573 ts_tablet_manager.cc:1905] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:31.423000 20543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.422450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:37721 (local address 127.0.0.1:55852)
0929 06:38:31.422923 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:31.422960 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:37721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455}
W20260929 06:38:31.423127 20062 catalog_manager.cc:4584] TS dc9f1cb3d3d945b2adb3cc72dad96c84 (127.15.157.129:37721): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3c078b95f2d34b9fb531fa02ac12f4b6: Network error: Client connection negotiation failed: client connection to 127.15.157.129:37721: connect: Connection refused (error 111)
I20260929 06:38:31.424588 20573 ts_tablet_manager.cc:1918] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:31.424651 20573 log.cc:1196] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/3c078b95f2d34b9fb531fa02ac12f4b6
I20260929 06:38:31.424907 20573 ts_tablet_manager.cc:1939] T 3c078b95f2d34b9fb531fa02ac12f4b6 P e63c0e0ed8df4359bdd4876eef15c6cd: Deleting consensus metadata
I20260929 06:38:31.425568 20060 catalog_manager.cc:4841] TS e63c0e0ed8df4359bdd4876eef15c6cd (127.15.157.131:44273): tablet 3c078b95f2d34b9fb531fa02ac12f4b6 (table test-table [id=cd7c096fe6c944b5be52f594b3e18d46]) successfully deleted
I20260929 06:38:31.428431 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 20403
I20260929 06:38:31.432826 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 20044
2026-09-29T06:38:31Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2115 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-09-29T06:38:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:31Z Disabled control of system clock
I20260929 06:38:31.459657 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:35891
--webserver_interface=127.15.157.190
--webserver_port=0
--builtin_ntp_servers=127.15.157.148:35227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:35891
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260929 06:38:31.538950 20578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:31.539145 20578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:31.539165 20578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:31.540315 20578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:31.540357 20578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:31.540370 20578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:31.540408 20578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:31.540434 20578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:31.541741 20578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:35227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:35891
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:35891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:31.541952 20578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:31.542236 20578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:31.546818 20583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:31.546809 20586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:31.546790 20584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:31.547017 20578 server_base.cc:1034] running on GCE node
I20260929 06:38:31.547328 20578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:31.547603 20578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:31.548741 20578 hybrid_clock.cc:648] HybridClock initialized: now 1790663911548732 us; error 26 us; skew 500 ppm
I20260929 06:38:31.549904 20578 webserver.cc:460] Webserver started at http://127.15.157.190:38451/ using document root <none> and password file <none>
I20260929 06:38:31.550168 20578 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:31.550216 20578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:31.550359 20578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:31.551360 20578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "e2539629fb4748e598a191199eaaef97"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "e6c6efd9f252e2ac3fe0864bedcfab0e"
server_key_iv: "8d0c3685bb5bb81fc05c59037e987887"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.551694 20578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "e2539629fb4748e598a191199eaaef97"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "e6c6efd9f252e2ac3fe0864bedcfab0e"
server_key_iv: "8d0c3685bb5bb81fc05c59037e987887"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.552910 20578 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:38:31.553638 20592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:31.553829 20578 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:31.553918 20578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "e2539629fb4748e598a191199eaaef97"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "e6c6efd9f252e2ac3fe0864bedcfab0e"
server_key_iv: "8d0c3685bb5bb81fc05c59037e987887"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.553982 20578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:31.557364 20578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:31.557615 20578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:31.557749 20578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:31.561817 20578 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:35891
I20260929 06:38:31.561844 20644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:35891 every 8 connection(s)
I20260929 06:38:31.562207 20578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:31.562804 20645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:31.563390 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 20578
I20260929 06:38:31.563472 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:31.563645 15990 external_mini_cluster.cc:1428] Setting key ccecc5f3d878c88615caac61c7e58124
I20260929 06:38:31.566162 20648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.564132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42834 (local address 127.15.157.190:35891)
0929 06:38:31.564330 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.564338 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.564368 (+ 30us) server_negotiation.cc:407] Connection header received
0929 06:38:31.564834 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.564842 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.564897 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.565045 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:31.565705 (+ 660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:31.565708 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:31.565709 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:31.565713 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:31.565755 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:31.565768 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:31.565843 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.565900 (+ 57us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.565954 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":73,"threads_started":1}
I20260929 06:38:31.566571 20645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97: Bootstrap starting.
I20260929 06:38:31.567216 20645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:31.567488 20645 log.cc:824] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:31.568147 20645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97: No bootstrap required, opened a new log
I20260929 06:38:31.569634 20645 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2539629fb4748e598a191199eaaef97" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 35891 } }
I20260929 06:38:31.569764 20645 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:31.569818 20645 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2539629fb4748e598a191199eaaef97, State: Initialized, Role: FOLLOWER
I20260929 06:38:31.569936 20645 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2539629fb4748e598a191199eaaef97" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 35891 } }
I20260929 06:38:31.570003 20645 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:31.570088 20645 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:31.570142 20645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:31.570618 20645 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2539629fb4748e598a191199eaaef97" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 35891 } }
I20260929 06:38:31.570722 20645 leader_election.cc:302] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2539629fb4748e598a191199eaaef97; no voters:
I20260929 06:38:31.570899 20645 leader_election.cc:288] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:31.571146 20650 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:31.571146 20645 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:31.571300 20650 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [term 1 LEADER]: Becoming Leader. State: Replica: e2539629fb4748e598a191199eaaef97, State: Running, Role: LEADER
I20260929 06:38:31.571398 20650 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2539629fb4748e598a191199eaaef97" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 35891 } }
I20260929 06:38:31.571790 20651 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2539629fb4748e598a191199eaaef97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2539629fb4748e598a191199eaaef97" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 35891 } } }
I20260929 06:38:31.571907 20651 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:31.571787 20652 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2539629fb4748e598a191199eaaef97. Latest consensus state: current_term: 1 leader_uuid: "e2539629fb4748e598a191199eaaef97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2539629fb4748e598a191199eaaef97" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 35891 } } }
I20260929 06:38:31.572140 20652 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:31.572312 20659 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:31.572855 20659 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:31.574417 20659 catalog_manager.cc:1347] Generated new cluster ID: be8515bcb8f04eb2b7d1935accac7b37
I20260929 06:38:31.574471 20659 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:31.591845 20659 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:31.592023 20659 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:31.596153 20659 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97: Generated new TSK 0
I20260929 06:38:31.596333 20659 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:38:31.603878 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:35891
--builtin_ntp_servers=127.15.157.148:35227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260929 06:38:31.689196 20669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:31.689424 20669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:31.689458 20669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:31.690662 20669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:31.690721 20669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:31.690771 20669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:31.692094 20669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:35227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:35891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:31.692356 20669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:31.692641 20669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:31.698216 20675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:31.698225 20674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:31.698346 20677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:31.698518 20669 server_base.cc:1034] running on GCE node
I20260929 06:38:31.698783 20669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:31.699035 20669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:31.700202 20669 hybrid_clock.cc:648] HybridClock initialized: now 1790663911700178 us; error 38 us; skew 500 ppm
I20260929 06:38:31.701578 20669 webserver.cc:460] Webserver started at http://127.15.157.129:33505/ using document root <none> and password file <none>
I20260929 06:38:31.701845 20669 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:31.701903 20669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:31.702054 20669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:31.703402 20669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "c86eb7ca35084596867a8ee14dedc57c"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "8dc4f39c62a4d076c6e6a00295afc366"
server_key_iv: "546f5d3ff1e59d4099776d94354e30a9"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.703802 20669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "c86eb7ca35084596867a8ee14dedc57c"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "8dc4f39c62a4d076c6e6a00295afc366"
server_key_iv: "546f5d3ff1e59d4099776d94354e30a9"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.705406 20669 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:38:31.706327 20683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:31.706502 20669 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:31.706583 20669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "c86eb7ca35084596867a8ee14dedc57c"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "8dc4f39c62a4d076c6e6a00295afc366"
server_key_iv: "546f5d3ff1e59d4099776d94354e30a9"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.706671 20669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:31.709764 20669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:31.710052 20669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:31.710183 20669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:31.710389 20669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:31.710688 20669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:31.710741 20669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:31.710788 20669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:31.710815 20669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:31.716024 20669 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:35373
I20260929 06:38:31.716120 20796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:35373 every 8 connection(s)
I20260929 06:38:31.716409 20669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:38:31.718739 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 20669
I20260929 06:38:31.718863 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:38:31.719053 15990 external_mini_cluster.cc:1428] Setting key a7eed9b6488efa5ceccc8a28bf85e94c
I20260929 06:38:31.719347 20648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.717113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:42725 (local address 127.15.157.190:35891)
0929 06:38:31.717189 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.717191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.717376 (+ 185us) server_negotiation.cc:407] Connection header received
0929 06:38:31.717816 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.717817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.717822 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.717873 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:31.719058 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:31.719059 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:31.719060 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:31.719065 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:31.719082 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:31.719086 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:31.719158 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.719262 (+ 104us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.719279 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 06:38:31.719545 20799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.717074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:35891 (local address 127.15.157.129:42725)
0929 06:38:31.717267 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:31.717297 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:31.717740 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:31.717922 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:31.717924 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:31.717932 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:31.718880 (+ 948us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:38:31.718881 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:31.718936 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:38:31.718970 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:31.719163 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:31.719169 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:31.719172 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:38:31.719266 (+ 94us) client_negotiation.cc:240] Negotiation successful
0929 06:38:31.719325 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":98,"threads_started":1}
I20260929 06:38:31.719966 20797 heartbeater.cc:347] Connected to a master server at 127.15.157.190:35891
I20260929 06:38:31.719983 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:35891
--builtin_ntp_servers=127.15.157.148:35227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260929 06:38:31.720057 20797 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:31.720191 20797 heartbeater.cc:511] Master 127.15.157.190:35891 requested a full tablet report, sending...
I20260929 06:38:31.720623 20601 ts_manager.cc:194] Registered new tserver with Master: c86eb7ca35084596867a8ee14dedc57c (127.15.157.129:35373)
W20260929 06:38:31.798712 20800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:31.798920 20800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:31.798950 20800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:31.800031 20800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:31.800063 20800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:31.800088 20800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:31.801326 20800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:35227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:35891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:31.801498 20800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:31.801728 20800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:31.806469 20808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:31.806485 20805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:31.806465 20806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:31.806687 20800 server_base.cc:1034] running on GCE node
I20260929 06:38:31.806951 20800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:31.807181 20800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:31.808346 20800 hybrid_clock.cc:648] HybridClock initialized: now 1790663911808324 us; error 30 us; skew 500 ppm
I20260929 06:38:31.809649 20800 webserver.cc:460] Webserver started at http://127.15.157.130:36639/ using document root <none> and password file <none>
I20260929 06:38:31.809854 20800 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:31.809894 20800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:31.810055 20800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:31.811069 20800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "168e6dd68ffb4659859b4228f07842f5"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "9c008462bcd1f7426b18cd3ec2f72008"
server_key_iv: "e81a3bffcbdb189d0df2b4bf04bcddc1"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.811357 20800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "168e6dd68ffb4659859b4228f07842f5"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "9c008462bcd1f7426b18cd3ec2f72008"
server_key_iv: "e81a3bffcbdb189d0df2b4bf04bcddc1"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.812525 20800 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:31.813148 20814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:31.813297 20800 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:31.813372 20800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "168e6dd68ffb4659859b4228f07842f5"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "9c008462bcd1f7426b18cd3ec2f72008"
server_key_iv: "e81a3bffcbdb189d0df2b4bf04bcddc1"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.813426 20800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:31.816658 20800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:31.816860 20800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:31.816952 20800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:31.817088 20800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:31.817318 20800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:31.817348 20800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:31.817366 20800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:31.817378 20800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:31.822731 20800 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:41427
I20260929 06:38:31.822788 20927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:41427 every 8 connection(s)
I20260929 06:38:31.823088 20800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:38:31.824666 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 20800
I20260929 06:38:31.824764 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:38:31.824949 15990 external_mini_cluster.cc:1428] Setting key b62aae4896fbdd684132e714e8dd0a22
I20260929 06:38:31.825996 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:35891
--builtin_ntp_servers=127.15.157.148:35227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260929 06:38:31.826320 20648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.823773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:35591 (local address 127.15.157.190:35891)
0929 06:38:31.823853 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.823856 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.824043 (+ 187us) server_negotiation.cc:407] Connection header received
0929 06:38:31.824561 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.824562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.824569 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.824643 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:31.825991 (+ 1348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:31.825992 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:31.825992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:31.825997 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:31.826012 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:31.826041 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:31.826111 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.826209 (+ 98us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.826224 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 06:38:31.826562 20930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.823749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:35891 (local address 127.15.157.130:35591)
0929 06:38:31.823930 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:31.823961 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:31.824439 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:31.824716 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:31.824719 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:31.824746 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:31.825850 (+ 1104us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:38:31.825850 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:31.825879 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:38:31.825905 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:31.826114 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:31.826119 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:31.826123 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:38:31.826208 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 06:38:31.826278 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":95,"threads_started":1}
I20260929 06:38:31.827031 20928 heartbeater.cc:347] Connected to a master server at 127.15.157.190:35891
I20260929 06:38:31.827119 20928 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:31.827282 20928 heartbeater.cc:511] Master 127.15.157.190:35891 requested a full tablet report, sending...
I20260929 06:38:31.827654 20601 ts_manager.cc:194] Registered new tserver with Master: 168e6dd68ffb4659859b4228f07842f5 (127.15.157.130:41427)
W20260929 06:38:31.905757 20931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:31.905937 20931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:31.905957 20931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:31.907106 20931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:31.907146 20931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:31.907172 20931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:31.908406 20931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:35227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:35891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:31.908573 20931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:31.908813 20931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:31.913889 20936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:31.913964 20931 server_base.cc:1034] running on GCE node
W20260929 06:38:31.913920 20939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:31.913916 20937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:31.914318 20931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:31.914542 20931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:31.915681 20931 hybrid_clock.cc:648] HybridClock initialized: now 1790663911915649 us; error 63 us; skew 500 ppm
I20260929 06:38:31.917001 20931 webserver.cc:460] Webserver started at http://127.15.157.131:43627/ using document root <none> and password file <none>
I20260929 06:38:31.917233 20931 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:31.917299 20931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:31.917428 20931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:31.918483 20931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "3476f1ae22efa3eab6a486b8c7e26888"
server_key_iv: "143f543c5117309309719452781a4269"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.918830 20931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "3476f1ae22efa3eab6a486b8c7e26888"
server_key_iv: "143f543c5117309309719452781a4269"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.920105 20931 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:38:31.920892 20945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:31.921059 20931 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:31.921152 20931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986"
format_stamp: "Formatted at 2026-09-29 06:38:31 on dist-test-slave-ltw5"
server_key: "3476f1ae22efa3eab6a486b8c7e26888"
server_key_iv: "143f543c5117309309719452781a4269"
server_key_version: "encryptionkey@0"
I20260929 06:38:31.921238 20931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:31.924391 20931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:31.924634 20931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:31.924767 20931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:31.924965 20931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:31.925252 20931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:31.925302 20931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:31.925340 20931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:31.925366 20931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:31.930763 20931 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:34099
I20260929 06:38:31.930792 21058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:34099 every 8 connection(s)
I20260929 06:38:31.931094 20931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:38:31.933760 20648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.931766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:48691 (local address 127.15.157.190:35891)
0929 06:38:31.931822 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.931824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.932044 (+ 220us) server_negotiation.cc:407] Connection header received
0929 06:38:31.932506 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.932507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.932511 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.932577 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:31.933582 (+ 1005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:31.933583 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:31.933583 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:31.933587 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:31.933599 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:31.933603 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:31.933647 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.933694 (+ 47us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.933705 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 06:38:31.933928 21061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.931756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:35891 (local address 127.15.157.131:48691)
0929 06:38:31.931923 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:31.931960 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:31.932420 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:31.932627 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:31.932630 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:31.932638 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:31.933457 (+ 819us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:38:31.933458 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:31.933482 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:38:31.933507 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:31.933645 (+ 138us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:31.933647 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:31.933649 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:38:31.933694 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 06:38:31.933736 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":79,"threads_started":1}
I20260929 06:38:31.934336 21059 heartbeater.cc:347] Connected to a master server at 127.15.157.190:35891
I20260929 06:38:31.934410 21059 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:31.934509 21059 heartbeater.cc:511] Master 127.15.157.190:35891 requested a full tablet report, sending...
I20260929 06:38:31.934811 20601 ts_manager.cc:194] Registered new tserver with Master: 2d6b4b237ecf431ebcf2e2d57c9d1986 (127.15.157.131:34099)
I20260929 06:38:31.940920 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 20931
I20260929 06:38:31.941007 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:38:31.941135 15990 external_mini_cluster.cc:1428] Setting key 1e5cdb8408c589c09c8eac92edc842a2
I20260929 06:38:31.942058 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:38:31.944239 20648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.943272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42842 (local address 127.15.157.190:35891)
0929 06:38:31.943330 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.943332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.943444 (+ 112us) server_negotiation.cc:407] Connection header received
0929 06:38:31.943482 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.943482 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.943486 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.943560 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:31.944100 (+ 540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:31.944100 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:31.944101 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:31.944103 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:31.944112 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:31.944115 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:31.944155 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.944185 (+ 30us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.944195 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 06:38:31.945783 20601 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42842:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:38:31.947335 20601 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:31.950748 21067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.949340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:41427 (local address 127.0.0.1:39392)
0929 06:38:31.949500 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:31.949534 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:31.949585 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:31.949754 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:31.949759 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:31.949764 (+ 5us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:31.950325 (+ 561us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:38:31.950325 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:31.950341 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:38:31.950362 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:31.950580 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:31.950585 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:31.950589 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:38:31.950650 (+ 61us) client_negotiation.cc:240] Negotiation successful
0929 06:38:31.950663 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":62,"threads_started":1}
I20260929 06:38:31.950976 21070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.949431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39392 (local address 127.15.157.130:41427)
0929 06:38:31.949597 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.949601 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.949612 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:38:31.949638 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.949640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.949652 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.949733 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:31.950452 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:31.950462 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:31.950463 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:31.950467 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:31.950503 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:31.950525 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:31.950586 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.950858 (+ 272us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.950875 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":63,"threads_started":1}
I20260929 06:38:31.951014 21069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.949340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:35373 (local address 127.0.0.1:39440)
0929 06:38:31.949748 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:31.949757 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:31.949802 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:31.950215 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:31.950215 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:31.950219 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:31.950654 (+ 435us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:38:31.950655 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:31.950661 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:38:31.950671 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:31.950898 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:31.950899 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:31.950899 (+ 0us) client_negotiation.cc:769] Sending connection context
0929 06:38:31.950941 (+ 42us) client_negotiation.cc:240] Negotiation successful
0929 06:38:31.950952 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"mutex_wait_us":2,"thread_start_us":88,"threads_started":1}
I20260929 06:38:31.951256 21072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.949574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39440 (local address 127.15.157.129:35373)
0929 06:38:31.949726 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.949731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.949796 (+ 65us) server_negotiation.cc:407] Connection header received
0929 06:38:31.949865 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.949868 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.949876 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.949948 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:31.950750 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:31.950758 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:31.950758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:31.950762 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:31.950795 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:31.950820 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:31.950875 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.951155 (+ 280us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.951171 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":91,"threads_started":1}
I20260929 06:38:31.951619 21068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.949348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:34099 (local address 127.0.0.1:56998)
0929 06:38:31.950163 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:31.950173 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:31.950215 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:31.950664 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:31.950664 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:31.950667 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:31.951275 (+ 608us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:38:31.951276 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:31.951282 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:38:31.951293 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:31.951503 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:31.951504 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:31.951504 (+ 0us) client_negotiation.cc:769] Sending connection context
0929 06:38:31.951544 (+ 40us) client_negotiation.cc:240] Negotiation successful
0929 06:38:31.951557 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"thread_start_us":85,"threads_started":1}
I20260929 06:38:31.951642 20862 tablet_service.cc:1467] Processing CreateTablet for tablet 3968d83566124297b332d2ef29db1ade (DEFAULT_TABLE table=test-table [id=accb54757ede4fa9a0b61d0534a4fbce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:31.951858 21071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:31.949541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56998 (local address 127.15.157.131:34099)
0929 06:38:31.949685 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:31.949688 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:31.950314 (+ 626us) server_negotiation.cc:407] Connection header received
0929 06:38:31.950339 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:31.950341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:31.950349 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:31.950401 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:31.951375 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:31.951381 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:31.951381 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:31.951385 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:31.951414 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:31.951433 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:31.951481 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:31.951762 (+ 281us) server_negotiation.cc:299] Negotiation successful
0929 06:38:31.951778 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":67,"threads_started":1}
I20260929 06:38:31.951861 20731 tablet_service.cc:1467] Processing CreateTablet for tablet 3968d83566124297b332d2ef29db1ade (DEFAULT_TABLE table=test-table [id=accb54757ede4fa9a0b61d0534a4fbce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:31.952018 20862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3968d83566124297b332d2ef29db1ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:31.952181 20731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3968d83566124297b332d2ef29db1ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:31.952392 20993 tablet_service.cc:1467] Processing CreateTablet for tablet 3968d83566124297b332d2ef29db1ade (DEFAULT_TABLE table=test-table [id=accb54757ede4fa9a0b61d0534a4fbce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:31.952683 20993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3968d83566124297b332d2ef29db1ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:31.954896 21073 tablet_bootstrap.cc:492] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c: Bootstrap starting.
I20260929 06:38:31.955284 21074 tablet_bootstrap.cc:492] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5: Bootstrap starting.
I20260929 06:38:31.955590 21073 tablet_bootstrap.cc:654] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:31.955818 21075 tablet_bootstrap.cc:492] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986: Bootstrap starting.
I20260929 06:38:31.955926 21074 tablet_bootstrap.cc:654] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:31.955962 21073 log.cc:824] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:31.956247 21074 log.cc:824] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:31.956575 21075 tablet_bootstrap.cc:654] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:31.956899 21074 tablet_bootstrap.cc:492] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5: No bootstrap required, opened a new log
I20260929 06:38:31.956924 21073 tablet_bootstrap.cc:492] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c: No bootstrap required, opened a new log
I20260929 06:38:31.956969 21074 ts_tablet_manager.cc:1397] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:38:31.956990 21075 log.cc:824] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:31.957012 21073 ts_tablet_manager.cc:1397] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:38:31.957762 21075 tablet_bootstrap.cc:492] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986: No bootstrap required, opened a new log
I20260929 06:38:31.957839 21075 ts_tablet_manager.cc:1397] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:38:31.959060 21074 raft_consensus.cc:348] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c86eb7ca35084596867a8ee14dedc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 35373 } } peers { permanent_uuid: "168e6dd68ffb4659859b4228f07842f5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 41427 } } peers { permanent_uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34099 } }
I20260929 06:38:31.959208 21074 raft_consensus.cc:374] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:31.959249 21074 raft_consensus.cc:729] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 168e6dd68ffb4659859b4228f07842f5, State: Initialized, Role: FOLLOWER
I20260929 06:38:31.959374 21074 consensus_queue.cc:260] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c86eb7ca35084596867a8ee14dedc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 35373 } } peers { permanent_uuid: "168e6dd68ffb4659859b4228f07842f5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 41427 } } peers { permanent_uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34099 } }
I20260929 06:38:31.959630 21074 ts_tablet_manager.cc:1428] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:38:31.959769 20928 heartbeater.cc:503] Master 127.15.157.190:35891 was elected leader, sending a full tablet report...
I20260929 06:38:31.959817 21073 raft_consensus.cc:348] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c86eb7ca35084596867a8ee14dedc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 35373 } } peers { permanent_uuid: "168e6dd68ffb4659859b4228f07842f5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 41427 } } peers { permanent_uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34099 } }
I20260929 06:38:31.960004 21073 raft_consensus.cc:374] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:31.960050 21073 raft_consensus.cc:729] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c86eb7ca35084596867a8ee14dedc57c, State: Initialized, Role: FOLLOWER
I20260929 06:38:31.960178 21073 consensus_queue.cc:260] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c86eb7ca35084596867a8ee14dedc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 35373 } } peers { permanent_uuid: "168e6dd68ffb4659859b4228f07842f5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 41427 } } peers { permanent_uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34099 } }
I20260929 06:38:31.960410 21073 ts_tablet_manager.cc:1428] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260929 06:38:31.960455 21075 raft_consensus.cc:348] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c86eb7ca35084596867a8ee14dedc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 35373 } } peers { permanent_uuid: "168e6dd68ffb4659859b4228f07842f5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 41427 } } peers { permanent_uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34099 } }
I20260929 06:38:31.960625 21075 raft_consensus.cc:374] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:31.960678 21075 raft_consensus.cc:729] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d6b4b237ecf431ebcf2e2d57c9d1986, State: Initialized, Role: FOLLOWER
I20260929 06:38:31.960812 20797 heartbeater.cc:503] Master 127.15.157.190:35891 was elected leader, sending a full tablet report...
I20260929 06:38:31.961035 21075 consensus_queue.cc:260] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c86eb7ca35084596867a8ee14dedc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 35373 } } peers { permanent_uuid: "168e6dd68ffb4659859b4228f07842f5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 41427 } } peers { permanent_uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34099 } }
I20260929 06:38:31.961297 21075 ts_tablet_manager.cc:1428] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:38:31.961323 21059 heartbeater.cc:503] Master 127.15.157.190:35891 was elected leader, sending a full tablet report...
W20260929 06:38:31.966878 20798 tablet.cc:2369] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:38:32.026906 21079 raft_consensus.cc:482] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:32.027024 21079 raft_consensus.cc:504] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c86eb7ca35084596867a8ee14dedc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 35373 } } peers { permanent_uuid: "168e6dd68ffb4659859b4228f07842f5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 41427 } } peers { permanent_uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34099 } }
I20260929 06:38:32.027412 21079 leader_election.cc:288] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c86eb7ca35084596867a8ee14dedc57c (127.15.157.129:35373), 2d6b4b237ecf431ebcf2e2d57c9d1986 (127.15.157.131:34099)
I20260929 06:38:32.028781 20930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:32.027608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:35373 (local address 127.15.157.130:42081)
0929 06:38:32.027666 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:32.027677 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:32.027720 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:32.027874 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:32.027875 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:32.027877 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:32.028374 (+ 497us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:38:32.028375 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:32.028383 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:38:32.028398 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:32.028609 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:32.028610 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:32.028611 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 06:38:32.028688 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 06:38:32.028703 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260929 06:38:32.028790 21072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:32.027698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:42081 (local address 127.15.157.129:35373)
0929 06:38:32.027736 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:32.027737 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:32.027754 (+ 17us) server_negotiation.cc:407] Connection header received
0929 06:38:32.027779 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:32.027780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:32.027784 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:32.027846 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:32.028497 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:32.028501 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:32.028501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:32.028509 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:32.028524 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:32.028528 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:32.028604 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:32.028692 (+ 88us) server_negotiation.cc:299] Negotiation successful
0929 06:38:32.028709 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260929 06:38:32.028927 21071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:32.027676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:40643 (local address 127.15.157.131:34099)
0929 06:38:32.027747 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:32.027750 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:32.028055 (+ 305us) server_negotiation.cc:407] Connection header received
0929 06:38:32.028138 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:32.028140 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:32.028145 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:32.028202 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:32.028689 (+ 487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:32.028691 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:32.028691 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:32.028697 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:32.028712 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:32.028716 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:32.028786 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:32.028834 (+ 48us) server_negotiation.cc:299] Negotiation successful
0929 06:38:32.028848 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 06:38:32.029042 21082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:32.027608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:34099 (local address 127.15.157.130:40643)
0929 06:38:32.027990 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:32.027999 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:32.028061 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:32.028212 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:32.028213 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:32.028215 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:32.028589 (+ 374us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:38:32.028590 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:32.028595 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:38:32.028607 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:32.028782 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:32.028783 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:32.028783 (+ 0us) client_negotiation.cc:769] Sending connection context
0929 06:38:32.028952 (+ 169us) client_negotiation.cc:240] Negotiation successful
0929 06:38:32.028964 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":174,"thread_start_us":142,"threads_started":1}
I20260929 06:38:32.029264 20751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3968d83566124297b332d2ef29db1ade" candidate_uuid: "168e6dd68ffb4659859b4228f07842f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c86eb7ca35084596867a8ee14dedc57c" is_pre_election: true
I20260929 06:38:32.029428 20751 raft_consensus.cc:2454] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 168e6dd68ffb4659859b4228f07842f5 in term 0.
I20260929 06:38:32.029399 21013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3968d83566124297b332d2ef29db1ade" candidate_uuid: "168e6dd68ffb4659859b4228f07842f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986" is_pre_election: true
I20260929 06:38:32.029546 21013 raft_consensus.cc:2454] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 168e6dd68ffb4659859b4228f07842f5 in term 0.
I20260929 06:38:32.029659 20816 leader_election.cc:302] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 168e6dd68ffb4659859b4228f07842f5, c86eb7ca35084596867a8ee14dedc57c; no voters:
I20260929 06:38:32.029771 21079 raft_consensus.cc:2781] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:32.029827 21079 raft_consensus.cc:482] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:32.029881 21079 raft_consensus.cc:3037] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:32.030615 21079 raft_consensus.cc:504] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c86eb7ca35084596867a8ee14dedc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 35373 } } peers { permanent_uuid: "168e6dd68ffb4659859b4228f07842f5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 41427 } } peers { permanent_uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34099 } }
I20260929 06:38:32.030748 21079 leader_election.cc:288] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [CANDIDATE]: Term 1 election: Requested vote from peers c86eb7ca35084596867a8ee14dedc57c (127.15.157.129:35373), 2d6b4b237ecf431ebcf2e2d57c9d1986 (127.15.157.131:34099)
I20260929 06:38:32.030886 21013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3968d83566124297b332d2ef29db1ade" candidate_uuid: "168e6dd68ffb4659859b4228f07842f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986"
I20260929 06:38:32.030879 20751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3968d83566124297b332d2ef29db1ade" candidate_uuid: "168e6dd68ffb4659859b4228f07842f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c86eb7ca35084596867a8ee14dedc57c"
I20260929 06:38:32.030953 20751 raft_consensus.cc:3037] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:32.030953 21013 raft_consensus.cc:3037] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:32.031803 20751 raft_consensus.cc:2454] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 168e6dd68ffb4659859b4228f07842f5 in term 1.
I20260929 06:38:32.031803 21013 raft_consensus.cc:2454] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 168e6dd68ffb4659859b4228f07842f5 in term 1.
I20260929 06:38:32.031960 20816 leader_election.cc:302] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 168e6dd68ffb4659859b4228f07842f5, c86eb7ca35084596867a8ee14dedc57c; no voters:
I20260929 06:38:32.032048 21079 raft_consensus.cc:2781] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:32.032188 21079 raft_consensus.cc:686] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [term 1 LEADER]: Becoming Leader. State: Replica: 168e6dd68ffb4659859b4228f07842f5, State: Running, Role: LEADER
I20260929 06:38:32.032280 21079 consensus_queue.cc:237] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c86eb7ca35084596867a8ee14dedc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 35373 } } peers { permanent_uuid: "168e6dd68ffb4659859b4228f07842f5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 41427 } } peers { permanent_uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34099 } }
I20260929 06:38:32.033038 20609 catalog_manager.cc:5495] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 168e6dd68ffb4659859b4228f07842f5 (127.15.157.130). New cstate: current_term: 1 leader_uuid: "168e6dd68ffb4659859b4228f07842f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c86eb7ca35084596867a8ee14dedc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 35373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "168e6dd68ffb4659859b4228f07842f5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 41427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34099 } health_report { overall_health: UNKNOWN } } }
I20260929 06:38:32.043605 21070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:32.042660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39404 (local address 127.15.157.130:41427)
0929 06:38:32.042715 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:32.042721 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:32.042729 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:32.042754 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:32.042755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:32.042764 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:32.042819 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:32.043343 (+ 524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:32.043343 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:32.043344 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:32.043347 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:32.043359 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:32.043362 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:32.043408 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:32.043506 (+ 98us) server_negotiation.cc:299] Negotiation successful
0929 06:38:32.043517 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 06:38:32.045135 21013 raft_consensus.cc:1261] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986 [term 1 FOLLOWER]: Refusing update from remote peer 168e6dd68ffb4659859b4228f07842f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:32.045162 20751 raft_consensus.cc:1261] T 3968d83566124297b332d2ef29db1ade P c86eb7ca35084596867a8ee14dedc57c [term 1 FOLLOWER]: Refusing update from remote peer 168e6dd68ffb4659859b4228f07842f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:32.045454 21079 consensus_queue.cc:1035] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d6b4b237ecf431ebcf2e2d57c9d1986" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:32.045590 21083 consensus_queue.cc:1035] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c86eb7ca35084596867a8ee14dedc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 35373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:32.047832 21086 mvcc.cc:205] Tried to move back new op lower bound from 7334559383734505472 to 7334559383684792320. Current Snapshot: MvccSnapshot[applied={T|T < 7334559383734505472}]
I20260929 06:38:32.048162 21088 mvcc.cc:205] Tried to move back new op lower bound from 7334559383734505472 to 7334559383684792320. Current Snapshot: MvccSnapshot[applied={T|T < 7334559383734505472}]
I20260929 06:38:32.048624 21087 mvcc.cc:205] Tried to move back new op lower bound from 7334559383734505472 to 7334559383684792320. Current Snapshot: MvccSnapshot[applied={T|T < 7334559383734505472}]
I20260929 06:38:32.049877 20601 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:32.049968 20601 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:32.050693 20601 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e2539629fb4748e598a191199eaaef97: Sending DeleteTablet for 3 replicas of tablet 3968d83566124297b332d2ef29db1ade
I20260929 06:38:32.051019 20731 tablet_service.cc:1514] Processing DeleteTablet for tablet 3968d83566124297b332d2ef29db1ade with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:32 UTC) from {username='slave'} at 127.0.0.1:39440
I20260929 06:38:32.051062 20862 tablet_service.cc:1514] Processing DeleteTablet for tablet 3968d83566124297b332d2ef29db1ade with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:32 UTC) from {username='slave'} at 127.0.0.1:39392
I20260929 06:38:32.051270 21097 tablet_replica.cc:330] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5: stopping tablet replica
I20260929 06:38:32.051309 20993 tablet_service.cc:1514] Processing DeleteTablet for tablet 3968d83566124297b332d2ef29db1ade with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:32 UTC) from {username='slave'} at 127.0.0.1:56998
I20260929 06:38:32.051460 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 20669
I20260929 06:38:32.051467 21097 raft_consensus.cc:2229] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:38:32.051489 21098 tablet_replica.cc:330] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986: stopping tablet replica
I20260929 06:38:32.051561 21098 raft_consensus.cc:2229] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:32.051659 21098 raft_consensus.cc:2258] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:32.052062 21097 raft_consensus.cc:2258] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:32.052505 21098 ts_tablet_manager.cc:1905] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:32.052505 21097 ts_tablet_manager.cc:1905] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:32.054462 21098 ts_tablet_manager.cc:1918] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:32.054602 21097 ts_tablet_manager.cc:1918] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:32.054672 21097 log.cc:1196] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/3968d83566124297b332d2ef29db1ade
I20260929 06:38:32.054979 21097 ts_tablet_manager.cc:1939] T 3968d83566124297b332d2ef29db1ade P 168e6dd68ffb4659859b4228f07842f5: Deleting consensus metadata
I20260929 06:38:32.055318 21098 log.cc:1196] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/3968d83566124297b332d2ef29db1ade
I20260929 06:38:32.055370 20593 catalog_manager.cc:4841] TS 168e6dd68ffb4659859b4228f07842f5 (127.15.157.130:41427): tablet 3968d83566124297b332d2ef29db1ade (table test-table [id=accb54757ede4fa9a0b61d0534a4fbce]) successfully deleted
I20260929 06:38:32.055570 21098 ts_tablet_manager.cc:1939] T 3968d83566124297b332d2ef29db1ade P 2d6b4b237ecf431ebcf2e2d57c9d1986: Deleting consensus metadata
I20260929 06:38:32.055940 20596 catalog_manager.cc:4841] TS 2d6b4b237ecf431ebcf2e2d57c9d1986 (127.15.157.131:34099): tablet 3968d83566124297b332d2ef29db1ade (table test-table [id=accb54757ede4fa9a0b61d0534a4fbce]) successfully deleted
W20260929 06:38:32.058247 20594 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:35373 (error 108)
I20260929 06:38:32.058700 21068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:32.058591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:35373 (local address 127.0.0.1:39444)
0929 06:38:32.058631 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:32.058665 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:35373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260929 06:38:32.058806 20594 catalog_manager.cc:4584] TS c86eb7ca35084596867a8ee14dedc57c (127.15.157.129:35373): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3968d83566124297b332d2ef29db1ade: Network error: Client connection negotiation failed: client connection to 127.15.157.129:35373: connect: Connection refused (error 111)
I20260929 06:38:32.058943 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 20800
I20260929 06:38:32.063444 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 20931
I20260929 06:38:32.068548 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 20578
2026-09-29T06:38:32Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (634 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260929 06:38:32.087954 15990 mini_oidc.cc:152] Starting JWKS server
I20260929 06:38:32.089007 15990 webserver.cc:460] Webserver started at https://127.0.0.1:38717/ using document root <none> and password file <none>
I20260929 06:38:32.089130 15990 mini_oidc.cc:189] Starting OIDC Discovery server
I20260929 06:38:32.089314 15990 webserver.cc:460] Webserver started at http://127.0.0.1:33499/ using document root <none> and password file <none>
2026-09-29T06:38:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:32Z Disabled control of system clock
I20260929 06:38:32.096903 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:36615
--webserver_interface=127.15.157.190
--webserver_port=0
--builtin_ntp_servers=127.15.157.148:36165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:36615
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38717/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/testchainca.cert with env {}
W20260929 06:38:32.176350 21105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:32.176545 21105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:32.176573 21105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:32.177686 21105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:32.177722 21105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:32.177735 21105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:32.177747 21105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:32.177759 21105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 06:38:32.177771 21105 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 06:38:32.177783 21105 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38717/jwks.json
I20260929 06:38:32.179349 21105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:36165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:36615
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:36615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38717/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:32.179543 21105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:32.179714 21105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:32.184582 21113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:32.184608 21110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:32.184608 21111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:32.184880 21105 server_base.cc:1034] running on GCE node
I20260929 06:38:32.185108 21105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:32.185375 21105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:32.186522 21105 hybrid_clock.cc:648] HybridClock initialized: now 1790663912186509 us; error 46 us; skew 500 ppm
I20260929 06:38:32.187733 21105 webserver.cc:460] Webserver started at http://127.15.157.190:46233/ using document root <none> and password file <none>
I20260929 06:38:32.187920 21105 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:32.187960 21105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:32.188045 21105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:32.189020 21105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "fa5ffe8da6bf4ea88709f856e2d9204c"
format_stamp: "Formatted at 2026-09-29 06:38:32 on dist-test-slave-ltw5"
server_key: "44786e330ab2b711e83cd9491f10175d"
server_key_iv: "4cfc9d49d41b22c20c7b313417c50a66"
server_key_version: "encryptionkey@0"
I20260929 06:38:32.189321 21105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "fa5ffe8da6bf4ea88709f856e2d9204c"
format_stamp: "Formatted at 2026-09-29 06:38:32 on dist-test-slave-ltw5"
server_key: "44786e330ab2b711e83cd9491f10175d"
server_key_iv: "4cfc9d49d41b22c20c7b313417c50a66"
server_key_version: "encryptionkey@0"
I20260929 06:38:32.190580 21105 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:38:32.191277 21119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:32.191426 21105 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:32.191509 21105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "fa5ffe8da6bf4ea88709f856e2d9204c"
format_stamp: "Formatted at 2026-09-29 06:38:32 on dist-test-slave-ltw5"
server_key: "44786e330ab2b711e83cd9491f10175d"
server_key_iv: "4cfc9d49d41b22c20c7b313417c50a66"
server_key_version: "encryptionkey@0"
I20260929 06:38:32.191563 21105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:32.209352 21105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:32.209640 21105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:32.209743 21105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:32.213405 21105 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:36615
I20260929 06:38:32.213438 21171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:36615 every 8 connection(s)
I20260929 06:38:32.213812 21105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:32.214824 21172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:32.217085 21172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c: Bootstrap starting.
I20260929 06:38:32.217679 21172 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:32.217962 21172 log.cc:824] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:32.218633 21172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c: No bootstrap required, opened a new log
I20260929 06:38:32.220121 21172 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa5ffe8da6bf4ea88709f856e2d9204c" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 36615 } }
I20260929 06:38:32.220255 21172 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:32.220301 21172 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5ffe8da6bf4ea88709f856e2d9204c, State: Initialized, Role: FOLLOWER
I20260929 06:38:32.220492 21172 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa5ffe8da6bf4ea88709f856e2d9204c" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 36615 } }
I20260929 06:38:32.220573 21172 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:32.220620 21172 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:32.220671 21172 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:32.220826 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 21105
I20260929 06:38:32.220935 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:32.221103 15990 external_mini_cluster.cc:1428] Setting key 6e52441920989d3bc216f363353a3d77
I20260929 06:38:32.221294 21172 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa5ffe8da6bf4ea88709f856e2d9204c" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 36615 } }
I20260929 06:38:32.221407 21172 leader_election.cc:302] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa5ffe8da6bf4ea88709f856e2d9204c; no voters:
I20260929 06:38:32.221575 21172 leader_election.cc:288] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:32.221609 21176 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:32.221755 21176 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [term 1 LEADER]: Becoming Leader. State: Replica: fa5ffe8da6bf4ea88709f856e2d9204c, State: Running, Role: LEADER
I20260929 06:38:32.221817 21172 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:32.221844 21176 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa5ffe8da6bf4ea88709f856e2d9204c" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 36615 } }
I20260929 06:38:32.222178 21176 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa5ffe8da6bf4ea88709f856e2d9204c. Latest consensus state: current_term: 1 leader_uuid: "fa5ffe8da6bf4ea88709f856e2d9204c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa5ffe8da6bf4ea88709f856e2d9204c" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 36615 } } }
I20260929 06:38:32.222254 21176 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:32.222605 21182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:32.223207 21182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:32.223208 21179 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa5ffe8da6bf4ea88709f856e2d9204c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa5ffe8da6bf4ea88709f856e2d9204c" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 36615 } } }
I20260929 06:38:32.223611 21179 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:32.227033 21182 catalog_manager.cc:1347] Generated new cluster ID: 7c3edd293f794d9f8a9979a6f38b9b35
I20260929 06:38:32.227088 21182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:32.227541 21177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:32.221586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37872 (local address 127.15.157.190:36615)
0929 06:38:32.221791 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:32.221800 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:32.222065 (+ 265us) server_negotiation.cc:407] Connection header received
0929 06:38:32.222262 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:32.222271 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:32.222353 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:32.222772 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:32.222869 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.224429 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.225197 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.225808 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.225935 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:32.226662 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:32.226666 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:32.226666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:32.226866 (+ 200us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:32.226908 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:32.226922 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:32.227236 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:32.227266 (+ 30us) server_negotiation.cc:299] Negotiation successful
0929 06:38:32.227350 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":84,"threads_started":1}
I20260929 06:38:32.228430 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:38:32.238852 21182 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:32.239360 21182 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:32.244246 21182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa5ffe8da6bf4ea88709f856e2d9204c: Generated new TSK 0
I20260929 06:38:32.244421 21182 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260929 06:38:32.266817 21202 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260929 06:38:32.266925 21202 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260929 06:38:32.267366 21201 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:32.252317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:36615 (local address 127.0.0.1:37882)
0929 06:38:32.252473 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:32.252484 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:32.252552 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:32.252734 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:32.252735 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:32.252737 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0929 06:38:32.252814 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:32.252816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.253448 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.253449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:32.254100 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:32.254103 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.254469 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.254471 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:32.254541 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:32.254559 (+ 18us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 06:38:32.267048 (+ 12489us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38717/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0929 06:38:32.267137 (+ 89us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.157.190:36615: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38717/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":74,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.15.157.190:36615: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38717/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260929 06:38:32.267795 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 21105
2026-09-29T06:38:32Z chronyd exiting
I20260929 06:38:32.303604 15990 test_util.cc:175] -----------------------------------------------
I20260929 06:38:32.303699 15990 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663890058284-15990-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (216 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260929 06:38:32.304452 15990 mini_oidc.cc:152] Starting JWKS server
I20260929 06:38:32.305121 15990 webserver.cc:460] Webserver started at https://127.0.0.1:35817/ using document root <none> and password file <none>
I20260929 06:38:32.305187 15990 mini_oidc.cc:189] Starting OIDC Discovery server
I20260929 06:38:32.305379 15990 webserver.cc:460] Webserver started at http://127.0.0.1:41013/ using document root <none> and password file <none>
2026-09-29T06:38:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:32Z Disabled control of system clock
I20260929 06:38:32.312790 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45367
--webserver_interface=127.15.157.190
--webserver_port=0
--builtin_ntp_servers=127.15.157.148:40789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:45367
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35817/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/testchainca.cert with env {}
W20260929 06:38:32.390918 21208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:32.391120 21208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:32.391142 21208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:32.392226 21208 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:32.392259 21208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:32.392271 21208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:32.392283 21208 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:32.392295 21208 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 06:38:32.392307 21208 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 06:38:32.392318 21208 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35817/jwks.json
I20260929 06:38:32.393714 21208 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:40789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:45367
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35817/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:32.393927 21208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:32.394110 21208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:32.398900 21216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:32.398918 21214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:32.398921 21213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:32.399209 21208 server_base.cc:1034] running on GCE node
I20260929 06:38:32.399499 21208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:32.399787 21208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:32.400949 21208 hybrid_clock.cc:648] HybridClock initialized: now 1790663912400938 us; error 30 us; skew 500 ppm
I20260929 06:38:32.407840 21208 webserver.cc:460] Webserver started at http://127.15.157.190:39069/ using document root <none> and password file <none>
I20260929 06:38:32.408097 21208 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:32.408169 21208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:32.408321 21208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:32.409361 21208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "1f5d009018694690ac3d151f9cb4e235"
format_stamp: "Formatted at 2026-09-29 06:38:32 on dist-test-slave-ltw5"
server_key: "44512228f21d67d598e4fb3a356ce969"
server_key_iv: "57059c98d3e626c1a17351635fe77b66"
server_key_version: "encryptionkey@0"
I20260929 06:38:32.409706 21208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "1f5d009018694690ac3d151f9cb4e235"
format_stamp: "Formatted at 2026-09-29 06:38:32 on dist-test-slave-ltw5"
server_key: "44512228f21d67d598e4fb3a356ce969"
server_key_iv: "57059c98d3e626c1a17351635fe77b66"
server_key_version: "encryptionkey@0"
I20260929 06:38:32.411044 21208 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:38:32.411965 21222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:32.412178 21208 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:32.412303 21208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "1f5d009018694690ac3d151f9cb4e235"
format_stamp: "Formatted at 2026-09-29 06:38:32 on dist-test-slave-ltw5"
server_key: "44512228f21d67d598e4fb3a356ce969"
server_key_iv: "57059c98d3e626c1a17351635fe77b66"
server_key_version: "encryptionkey@0"
I20260929 06:38:32.412377 21208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:32.423254 21208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:32.423547 21208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:32.423693 21208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:32.427484 21208 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:45367
I20260929 06:38:32.427515 21274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:45367 every 8 connection(s)
I20260929 06:38:32.427855 21208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:32.428455 21275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:32.431068 21275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235: Bootstrap starting.
I20260929 06:38:32.431558 21275 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:32.431777 21275 log.cc:824] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:32.432358 21275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235: No bootstrap required, opened a new log
I20260929 06:38:32.433931 21275 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5d009018694690ac3d151f9cb4e235" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45367 } }
I20260929 06:38:32.434120 21275 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:32.434147 21275 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f5d009018694690ac3d151f9cb4e235, State: Initialized, Role: FOLLOWER
I20260929 06:38:32.434274 21275 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5d009018694690ac3d151f9cb4e235" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45367 } }
I20260929 06:38:32.434353 21275 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:32.434376 21275 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:32.434403 21275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:32.434859 21275 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5d009018694690ac3d151f9cb4e235" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45367 } }
I20260929 06:38:32.434933 21275 leader_election.cc:302] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f5d009018694690ac3d151f9cb4e235; no voters:
I20260929 06:38:32.435050 21275 leader_election.cc:288] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:32.435109 21278 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:32.435277 21278 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [term 1 LEADER]: Becoming Leader. State: Replica: 1f5d009018694690ac3d151f9cb4e235, State: Running, Role: LEADER
I20260929 06:38:32.435300 21275 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:32.435371 21278 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5d009018694690ac3d151f9cb4e235" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45367 } }
I20260929 06:38:32.435737 21279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f5d009018694690ac3d151f9cb4e235" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5d009018694690ac3d151f9cb4e235" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45367 } } }
I20260929 06:38:32.435832 21279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:32.435915 21280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f5d009018694690ac3d151f9cb4e235. Latest consensus state: current_term: 1 leader_uuid: "1f5d009018694690ac3d151f9cb4e235" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5d009018694690ac3d151f9cb4e235" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45367 } } }
I20260929 06:38:32.435981 21280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:32.436479 21286 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:32.436928 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 21208
I20260929 06:38:32.437037 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:32.436937 21286 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:32.437183 15990 external_mini_cluster.cc:1428] Setting key 6e7b0802d8374dffb2ced1101f46c343
I20260929 06:38:32.438562 21286 catalog_manager.cc:1347] Generated new cluster ID: 4f88cdf81ba7484283fafbbef32714b1
I20260929 06:38:32.438614 21286 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:32.442979 21297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:32.437616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44008 (local address 127.15.157.190:45367)
0929 06:38:32.437794 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:32.437802 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:32.437844 (+ 42us) server_negotiation.cc:407] Connection header received
0929 06:38:32.437979 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:32.437987 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:32.438079 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:32.438234 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:32.438406 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.439781 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.440921 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.441486 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.441585 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:32.442327 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:32.442331 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:32.442331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:32.442519 (+ 188us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:32.442556 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:32.442569 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:32.442629 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:32.442719 (+ 90us) server_negotiation.cc:299] Negotiation successful
0929 06:38:32.442789 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":71,"threads_started":1}
I20260929 06:38:32.443958 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:38:32.467540 21286 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:32.468096 21286 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:32.475996 21286 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f5d009018694690ac3d151f9cb4e235: Generated new TSK 0
I20260929 06:38:32.476179 21286 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260929 06:38:32.499655 21305 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260929 06:38:32.499830 21305 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260929 06:38:32.500092 21297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:32.485933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44024 (local address 127.15.157.190:45367)
0929 06:38:32.485974 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:32.485976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:32.486169 (+ 193us) server_negotiation.cc:407] Connection header received
0929 06:38:32.486248 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:32.486248 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:32.486261 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:32.486328 (+ 67us) server_negotiation.cc:226] Negotiated authn=JWT
0929 06:38:32.486454 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.486949 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.487746 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.487967 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.488050 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:32.488228 (+ 178us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 06:38:32.499878 (+ 11650us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35817/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0929 06:38:32.500044 (+ 166us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44024: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35817/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":21}
W20260929 06:38:32.500157 21297 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44024: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35817/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260929 06:38:32.500252 21304 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:32.485862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45367 (local address 127.0.0.1:44024)
0929 06:38:32.486106 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:32.486118 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:32.486188 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:32.486326 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:32.486327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:32.486328 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0929 06:38:32.486386 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:32.486388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.487044 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.487045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:32.487660 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:32.487661 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.488054 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.488056 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:32.488114 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:32.488119 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 06:38:32.500015 (+ 11896us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35817/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0929 06:38:32.500150 (+ 135us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.157.190:45367: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35817/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":67,"threads_started":1}
I20260929 06:38:32.500444 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 21208
2026-09-29T06:38:32Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (233 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260929 06:38:32.537923 15990 mini_oidc.cc:152] Starting JWKS server
I20260929 06:38:32.538671 15990 webserver.cc:460] Webserver started at https://127.0.0.1:34387/ using document root <none> and password file <none>
I20260929 06:38:32.538712 15990 mini_oidc.cc:189] Starting OIDC Discovery server
I20260929 06:38:32.538944 15990 webserver.cc:460] Webserver started at http://127.0.0.1:46675/ using document root <none> and password file <none>
2026-09-29T06:38:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:32Z Disabled control of system clock
I20260929 06:38:32.547842 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:39267
--webserver_interface=127.15.157.190
--webserver_port=0
--builtin_ntp_servers=127.15.157.148:35863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:39267
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34387/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260929 06:38:32.644289 21311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:32.644490 21311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:32.644511 21311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:32.645661 21311 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:32.645699 21311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:32.645710 21311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:32.645723 21311 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:32.645735 21311 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 06:38:32.645747 21311 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 06:38:32.645766 21311 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34387/jwks.json
I20260929 06:38:32.647367 21311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:35863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:39267
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:39267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34387/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:32.647572 21311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:32.647836 21311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:32.652626 21317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:32.652783 21311 server_base.cc:1034] running on GCE node
W20260929 06:38:32.652628 21319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:32.652815 21316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:32.653069 21311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:32.653298 21311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:32.654458 21311 hybrid_clock.cc:648] HybridClock initialized: now 1790663912654439 us; error 30 us; skew 500 ppm
I20260929 06:38:32.655726 21311 webserver.cc:460] Webserver started at http://127.15.157.190:42247/ using document root <none> and password file <none>
I20260929 06:38:32.655963 21311 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:32.656033 21311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:32.656188 21311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:32.657227 21311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "aa264750d6ad48a6bb0bf2be0dca9b75"
format_stamp: "Formatted at 2026-09-29 06:38:32 on dist-test-slave-ltw5"
server_key: "a0437cca5bf1e38f4609f7ccc5a964db"
server_key_iv: "ca694ea6d89d14d869273ed60fc3dea4"
server_key_version: "encryptionkey@0"
I20260929 06:38:32.657580 21311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "aa264750d6ad48a6bb0bf2be0dca9b75"
format_stamp: "Formatted at 2026-09-29 06:38:32 on dist-test-slave-ltw5"
server_key: "a0437cca5bf1e38f4609f7ccc5a964db"
server_key_iv: "ca694ea6d89d14d869273ed60fc3dea4"
server_key_version: "encryptionkey@0"
I20260929 06:38:32.658946 21311 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:38:32.659643 21325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:32.659807 21311 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:32.659901 21311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "aa264750d6ad48a6bb0bf2be0dca9b75"
format_stamp: "Formatted at 2026-09-29 06:38:32 on dist-test-slave-ltw5"
server_key: "a0437cca5bf1e38f4609f7ccc5a964db"
server_key_iv: "ca694ea6d89d14d869273ed60fc3dea4"
server_key_version: "encryptionkey@0"
I20260929 06:38:32.659982 21311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:32.676370 21311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:32.676693 21311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:32.676857 21311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:32.680779 21311 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:39267
I20260929 06:38:32.680835 21377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:39267 every 8 connection(s)
I20260929 06:38:32.681185 21311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:32.681810 21378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:32.683280 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 21311
I20260929 06:38:32.683386 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:32.683569 15990 external_mini_cluster.cc:1428] Setting key 8a6956e071dbc9a56c23dde6ef834ef1
I20260929 06:38:32.685017 21378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75: Bootstrap starting.
I20260929 06:38:32.685627 21378 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:32.685901 21378 log.cc:824] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:32.686653 21378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75: No bootstrap required, opened a new log
I20260929 06:38:32.689164 21381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:32.684101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49814 (local address 127.15.157.190:39267)
0929 06:38:32.684307 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:32.684314 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:32.684339 (+ 25us) server_negotiation.cc:407] Connection header received
0929 06:38:32.684829 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:32.684835 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:32.684895 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:32.685010 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:32.685230 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.686255 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.687062 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.687689 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.687816 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:32.688447 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:32.688452 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:32.688452 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:32.688690 (+ 238us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:32.688741 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:32.688758 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:32.688834 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:32.688892 (+ 58us) server_negotiation.cc:299] Negotiation successful
0929 06:38:32.688969 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
I20260929 06:38:32.689087 21378 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa264750d6ad48a6bb0bf2be0dca9b75" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 39267 } }
I20260929 06:38:32.689241 21378 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:32.689280 21378 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa264750d6ad48a6bb0bf2be0dca9b75, State: Initialized, Role: FOLLOWER
I20260929 06:38:32.689415 21378 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa264750d6ad48a6bb0bf2be0dca9b75" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 39267 } }
I20260929 06:38:32.689499 21378 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:32.689536 21378 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:32.689581 21378 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:32.690094 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:38:32.690274 21378 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa264750d6ad48a6bb0bf2be0dca9b75" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 39267 } }
I20260929 06:38:32.690374 21378 leader_election.cc:302] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa264750d6ad48a6bb0bf2be0dca9b75; no voters:
I20260929 06:38:32.690522 21378 leader_election.cc:288] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:32.690577 21383 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:32.690717 21383 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [term 1 LEADER]: Becoming Leader. State: Replica: aa264750d6ad48a6bb0bf2be0dca9b75, State: Running, Role: LEADER
I20260929 06:38:32.690773 21378 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:32.690798 21383 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa264750d6ad48a6bb0bf2be0dca9b75" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 39267 } }
I20260929 06:38:32.691113 21384 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa264750d6ad48a6bb0bf2be0dca9b75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa264750d6ad48a6bb0bf2be0dca9b75" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 39267 } } }
I20260929 06:38:32.691191 21384 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:32.691367 21385 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa264750d6ad48a6bb0bf2be0dca9b75. Latest consensus state: current_term: 1 leader_uuid: "aa264750d6ad48a6bb0bf2be0dca9b75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa264750d6ad48a6bb0bf2be0dca9b75" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 39267 } } }
I20260929 06:38:32.691393 21389 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:32.691442 21385 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:32.691900 21389 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:32.693430 21389 catalog_manager.cc:1347] Generated new cluster ID: b4a0c032cda04900bc1b21f0fe09502a
I20260929 06:38:32.693481 21389 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:32.711490 21389 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:32.711997 21389 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:32.722268 21389 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa264750d6ad48a6bb0bf2be0dca9b75: Generated new TSK 0
I20260929 06:38:32.722483 21389 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:38:32.730492 21381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:32.726883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49828 (local address 127.15.157.190:39267)
0929 06:38:32.726941 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:32.726943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:32.727041 (+ 98us) server_negotiation.cc:407] Connection header received
0929 06:38:32.727122 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:32.727123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:32.727132 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:32.727190 (+ 58us) server_negotiation.cc:226] Negotiated authn=JWT
0929 06:38:32.727337 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.727817 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.728992 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.729170 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.729214 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:32.729388 (+ 174us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 06:38:32.730276 (+ 888us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34387/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0929 06:38:32.730417 (+ 141us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49828: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34387/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":34}
W20260929 06:38:32.730542 21381 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49828: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34387/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260929 06:38:32.730603 21407 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:32.726831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:39267 (local address 127.0.0.1:49828)
0929 06:38:32.726976 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:32.726988 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:32.727056 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:32.727208 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:32.727209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:32.727211 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0929 06:38:32.727273 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:32.727276 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.727899 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.727900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:32.728908 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:32.728911 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.729237 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.729238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:32.729297 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:32.729302 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 06:38:32.730398 (+ 1096us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34387/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0929 06:38:32.730499 (+ 101us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.157.190:39267: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34387/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":92,"threads_started":1}
I20260929 06:38:32.730816 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 21311
E20260929 06:38:32.741753 21408 webserver.cc:533] Webserver: sslize failed:
E20260929 06:38:32.741822 21408 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-09-29T06:38:32Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (229 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-09-29T06:38:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:32Z Disabled control of system clock
I20260929 06:38:32.775991 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:35251
--webserver_interface=127.15.157.190
--webserver_port=0
--builtin_ntp_servers=127.15.157.148:35009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:35251
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/testchainca.cert with env {}
W20260929 06:38:32.854974 21412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:32.855176 21412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:32.855198 21412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:32.856393 21412 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:32.856437 21412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:32.856449 21412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:32.856462 21412 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:32.856503 21412 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 06:38:32.856534 21412 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 06:38:32.856550 21412 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260929 06:38:32.858054 21412 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:35009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:35251
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:35251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:32.858310 21412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:32.858525 21412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:32.863415 21420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:32.863447 21417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:32.863457 21418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:32.863466 21412 server_base.cc:1034] running on GCE node
I20260929 06:38:32.863719 21412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:32.863973 21412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:32.865108 21412 hybrid_clock.cc:648] HybridClock initialized: now 1790663912865097 us; error 27 us; skew 500 ppm
I20260929 06:38:32.866295 21412 webserver.cc:460] Webserver started at http://127.15.157.190:40025/ using document root <none> and password file <none>
I20260929 06:38:32.866559 21412 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:32.866621 21412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:32.866766 21412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:32.867843 21412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "6c8497882aeb4265ad68d2499c12a3dd"
format_stamp: "Formatted at 2026-09-29 06:38:32 on dist-test-slave-ltw5"
server_key: "befb70db0261f4657981022dd6751678"
server_key_iv: "37e6936543bba30662e1a8620f17f65f"
server_key_version: "encryptionkey@0"
I20260929 06:38:32.868182 21412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "6c8497882aeb4265ad68d2499c12a3dd"
format_stamp: "Formatted at 2026-09-29 06:38:32 on dist-test-slave-ltw5"
server_key: "befb70db0261f4657981022dd6751678"
server_key_iv: "37e6936543bba30662e1a8620f17f65f"
server_key_version: "encryptionkey@0"
I20260929 06:38:32.869499 21412 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:38:32.870234 21426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:32.870417 21412 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:32.870488 21412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "6c8497882aeb4265ad68d2499c12a3dd"
format_stamp: "Formatted at 2026-09-29 06:38:32 on dist-test-slave-ltw5"
server_key: "befb70db0261f4657981022dd6751678"
server_key_iv: "37e6936543bba30662e1a8620f17f65f"
server_key_version: "encryptionkey@0"
I20260929 06:38:32.870575 21412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:32.880944 21412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:32.881260 21412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:32.881413 21412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:32.885156 21412 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:35251
I20260929 06:38:32.885187 21478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:35251 every 8 connection(s)
I20260929 06:38:32.885531 21412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:32.886574 21479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:32.888794 21479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd: Bootstrap starting.
I20260929 06:38:32.889374 21479 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:32.889657 21479 log.cc:824] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:32.890079 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 21412
I20260929 06:38:32.890187 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:32.890376 15990 external_mini_cluster.cc:1428] Setting key 94d15af1284bde4f53ab2807fc5f3c52
I20260929 06:38:32.890473 21479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd: No bootstrap required, opened a new log
I20260929 06:38:32.893252 21479 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c8497882aeb4265ad68d2499c12a3dd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 35251 } }
I20260929 06:38:32.893425 21479 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:32.893455 21479 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c8497882aeb4265ad68d2499c12a3dd, State: Initialized, Role: FOLLOWER
I20260929 06:38:32.893579 21479 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c8497882aeb4265ad68d2499c12a3dd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 35251 } }
I20260929 06:38:32.893662 21479 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:32.893698 21479 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:32.893756 21479 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:32.894411 21479 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c8497882aeb4265ad68d2499c12a3dd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 35251 } }
I20260929 06:38:32.894529 21479 leader_election.cc:302] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c8497882aeb4265ad68d2499c12a3dd; no voters:
I20260929 06:38:32.894685 21479 leader_election.cc:288] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:32.894708 21484 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:32.894824 21484 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [term 1 LEADER]: Becoming Leader. State: Replica: 6c8497882aeb4265ad68d2499c12a3dd, State: Running, Role: LEADER
I20260929 06:38:32.894901 21484 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c8497882aeb4265ad68d2499c12a3dd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 35251 } }
I20260929 06:38:32.894932 21479 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:32.895216 21484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c8497882aeb4265ad68d2499c12a3dd. Latest consensus state: current_term: 1 leader_uuid: "6c8497882aeb4265ad68d2499c12a3dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c8497882aeb4265ad68d2499c12a3dd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 35251 } } }
I20260929 06:38:32.895319 21484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:32.895226 21486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c8497882aeb4265ad68d2499c12a3dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c8497882aeb4265ad68d2499c12a3dd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 35251 } } }
I20260929 06:38:32.895457 21486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd [sys.catalog]: This master's current role is: LEADER
W20260929 06:38:32.896622 21499 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:38:32.896719 21499 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:38:32.896826 21490 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:32.896957 21483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:32.890943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58850 (local address 127.15.157.190:35251)
0929 06:38:32.891191 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:32.891200 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:32.891235 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:38:32.891863 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:32.891872 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:32.891949 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:32.892102 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:32.892249 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.893636 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.894589 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.895196 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.895687 (+ 491us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:32.896088 (+ 401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:32.896092 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:32.896093 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:32.896309 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:32.896357 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:32.896374 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:32.896434 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:32.896622 (+ 188us) server_negotiation.cc:299] Negotiation successful
0929 06:38:32.896701 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":100,"threads_started":1}
I20260929 06:38:32.897017 21490 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:32.897912 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:38:32.898716 21490 catalog_manager.cc:1347] Generated new cluster ID: 606584ab8b7340c1a482379f4f6a71bc
I20260929 06:38:32.898777 21490 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:32.907656 21490 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:32.908248 21490 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:32.910203 21490 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c8497882aeb4265ad68d2499c12a3dd: Generated new TSK 0
I20260929 06:38:32.910385 21490 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:38:32.968367 21483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:32.917953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58862 (local address 127.15.157.190:35251)
0929 06:38:32.917994 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:32.917995 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:32.918068 (+ 73us) server_negotiation.cc:407] Connection header received
0929 06:38:32.918138 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:32.918138 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:32.918148 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:32.918199 (+ 51us) server_negotiation.cc:226] Negotiated authn=JWT
0929 06:38:32.918347 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.918807 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.919919 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.920095 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.920141 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:32.920314 (+ 173us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 06:38:32.968147 (+ 47833us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0929 06:38:32.968308 (+ 161us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58862: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":20}
W20260929 06:38:32.968454 21483 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58862: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260929 06:38:32.968587 21508 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:32.917835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:35251 (local address 127.0.0.1:58862)
0929 06:38:32.917977 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:32.917988 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:32.918067 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:32.918214 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:32.918214 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:32.918216 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0929 06:38:32.918278 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:32.918279 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.918892 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.918893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:32.919842 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:32.919844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:32.920163 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:32.920164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:32.920224 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:32.920229 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 06:38:32.968327 (+ 48098us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0929 06:38:32.968482 (+ 155us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.157.190:35251: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":94,"threads_started":1}
I20260929 06:38:32.968956 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 21412
2026-09-29T06:38:32Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (218 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (86 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (86 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:33 dist-test-slave-ltw5 krb5kdc[21520](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:33 dist-test-slave-ltw5 krb5kdc[21520](info): set up 2 sockets
Sep 29 06:38:33 dist-test-slave-ltw5 krb5kdc[21520](info): commencing operation
krb5kdc: starting...
W20260929 06:38:34.166281 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:38:34.284261 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:32845
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:44739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:32845
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:34.362660 21533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:34.362861 21533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:34.362883 21533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:34.363948 21533 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:34.363981 21533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:34.363996 21533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:34.364007 21533 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:34.364019 21533 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:34.365350 21533 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:44739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:32845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:32845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:34.365527 21533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:34.365686 21533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:34.370338 21541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:34.370388 21538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:34.370400 21533 server_base.cc:1034] running on GCE node
W20260929 06:38:34.370388 21539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:34.370750 21533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:34.370980 21533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:34.372145 21533 hybrid_clock.cc:648] HybridClock initialized: now 1790663914372124 us; error 31 us; skew 500 ppm
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:34.374455 21533 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:38:34.374904 21533 webserver.cc:460] Webserver started at http://127.15.157.190:42099/ using document root <none> and password file <none>
I20260929 06:38:34.375135 21533 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:34.375204 21533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:34.375355 21533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:34.376398 21533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "0f259e3418694f25a90edf146cbd6918"
format_stamp: "Formatted at 2026-09-29 06:38:34 on dist-test-slave-ltw5"
server_key: "b5948c081e2b31a2c6139e30ccaaf77a"
server_key_iv: "9ae5d71db6c08ce61233e014b32773fb"
server_key_version: "encryptionkey@0"
I20260929 06:38:34.376747 21533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "0f259e3418694f25a90edf146cbd6918"
format_stamp: "Formatted at 2026-09-29 06:38:34 on dist-test-slave-ltw5"
server_key: "b5948c081e2b31a2c6139e30ccaaf77a"
server_key_iv: "9ae5d71db6c08ce61233e014b32773fb"
server_key_version: "encryptionkey@0"
I20260929 06:38:34.378057 21533 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:38:34.378800 21548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:34.378985 21533 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:34.379082 21533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "0f259e3418694f25a90edf146cbd6918"
format_stamp: "Formatted at 2026-09-29 06:38:34 on dist-test-slave-ltw5"
server_key: "b5948c081e2b31a2c6139e30ccaaf77a"
server_key_iv: "9ae5d71db6c08ce61233e014b32773fb"
server_key_version: "encryptionkey@0"
I20260929 06:38:34.379166 21533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:34.410204 21533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:34.412575 21533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:34.412748 21533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:34.416735 21533 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:32845
I20260929 06:38:34.416774 21600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:32845 every 8 connection(s)
I20260929 06:38:34.417143 21533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:34.417966 21601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:34.418973 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 21533
I20260929 06:38:34.419075 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:34.419262 15990 external_mini_cluster.cc:1428] Setting key 9fbea62234011b88ec39b41ae680dd50
I20260929 06:38:34.420717 21601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918: Bootstrap starting.
I20260929 06:38:34.421453 21601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:34.421766 21601 log.cc:824] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:34.422480 21601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918: No bootstrap required, opened a new log
I20260929 06:38:34.424834 21601 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f259e3418694f25a90edf146cbd6918" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 32845 } }
I20260929 06:38:34.425007 21601 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:34.425048 21601 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f259e3418694f25a90edf146cbd6918, State: Initialized, Role: FOLLOWER
I20260929 06:38:34.425190 21601 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f259e3418694f25a90edf146cbd6918" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 32845 } }
I20260929 06:38:34.425276 21601 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:34.425310 21601 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:34.425369 21601 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:34.426082 21601 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f259e3418694f25a90edf146cbd6918" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 32845 } }
I20260929 06:38:34.426174 21601 leader_election.cc:302] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f259e3418694f25a90edf146cbd6918; no voters:
I20260929 06:38:34.426339 21601 leader_election.cc:288] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:34.426358 21606 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [term 1 FOLLOWER]: Leader election won for term 1
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:34.426476 21606 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [term 1 LEADER]: Becoming Leader. State: Replica: 0f259e3418694f25a90edf146cbd6918, State: Running, Role: LEADER
I20260929 06:38:34.426555 21606 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f259e3418694f25a90edf146cbd6918" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 32845 } }
I20260929 06:38:34.426589 21601 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:34.426883 21606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f259e3418694f25a90edf146cbd6918. Latest consensus state: current_term: 1 leader_uuid: "0f259e3418694f25a90edf146cbd6918" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f259e3418694f25a90edf146cbd6918" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 32845 } } }
I20260929 06:38:34.426949 21606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:34.427075 21607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f259e3418694f25a90edf146cbd6918" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f259e3418694f25a90edf146cbd6918" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 32845 } } }
I20260929 06:38:34.427158 21607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918 [sys.catalog]: This master's current role is: LEADER
W20260929 06:38:34.428475 21621 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:38:34.428529 21621 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:38:34.428571 21622 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:34.428697 21622 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:34.430160 21622 catalog_manager.cc:1347] Generated new cluster ID: d13e1ce424ea415ba1c66cc522e1e3de
I20260929 06:38:34.430210 21622 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:34.430845 21604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:34.419794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59206 (local address 127.15.157.190:32845)
0929 06:38:34.419976 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:34.419985 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:34.420018 (+ 33us) server_negotiation.cc:407] Connection header received
0929 06:38:34.420553 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:34.420561 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:34.420609 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:34.420747 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:34.421490 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.422665 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.423680 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.424074 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.424149 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:34.427105 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:34.427109 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:34.427109 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:34.427120 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:34.429076 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:34.429494 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:34.429497 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:34.429497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:34.429607 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:34.429819 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:34.429820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:34.429820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:34.430139 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:34.430285 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:34.430527 (+ 242us) server_negotiation.cc:299] Negotiation successful
0929 06:38:34.430651 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":97,"threads_started":1}
I20260929 06:38:34.437088 21622 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:34.437589 21622 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:34.442237 21622 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f259e3418694f25a90edf146cbd6918: Generated new TSK 0
I20260929 06:38:34.442394 21622 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:38:34.468755 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:32845
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:44739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:34.550558 21627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:34.550768 21627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:34.550791 21627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:34.551921 21627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:34.551961 21627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:34.551987 21627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:34.553485 21627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:44739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:32845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:34.553735 21627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:34.553974 21627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:34.558818 21632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:34.558887 21633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:34.558841 21635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:34.559244 21627 server_base.cc:1034] running on GCE node
I20260929 06:38:34.559506 21627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:34.559749 21627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:34.560912 21627 hybrid_clock.cc:648] HybridClock initialized: now 1790663914560898 us; error 27 us; skew 500 ppm
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:34.563406 21627 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:38:34.563822 21627 webserver.cc:460] Webserver started at http://127.15.157.129:34553/ using document root <none> and password file <none>
I20260929 06:38:34.564039 21627 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:34.564105 21627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:34.564251 21627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:34.565389 21627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "41459255f7d04e179c0eb0509d140ce1"
format_stamp: "Formatted at 2026-09-29 06:38:34 on dist-test-slave-ltw5"
server_key: "a856f8a749beec82972db4282f2c506d"
server_key_iv: "4d0dabebbe90c4a7b081fef27f739c43"
server_key_version: "encryptionkey@0"
I20260929 06:38:34.565801 21627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "41459255f7d04e179c0eb0509d140ce1"
format_stamp: "Formatted at 2026-09-29 06:38:34 on dist-test-slave-ltw5"
server_key: "a856f8a749beec82972db4282f2c506d"
server_key_iv: "4d0dabebbe90c4a7b081fef27f739c43"
server_key_version: "encryptionkey@0"
I20260929 06:38:34.567232 21627 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:38:34.567948 21642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:34.568113 21627 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:34.568212 21627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "41459255f7d04e179c0eb0509d140ce1"
format_stamp: "Formatted at 2026-09-29 06:38:34 on dist-test-slave-ltw5"
server_key: "a856f8a749beec82972db4282f2c506d"
server_key_iv: "4d0dabebbe90c4a7b081fef27f739c43"
server_key_version: "encryptionkey@0"
I20260929 06:38:34.568291 21627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:34.584436 21627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:34.586326 21627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:34.586484 21627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:34.586705 21627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:34.587001 21627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:34.587054 21627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:34.587095 21627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:34.587123 21627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:34.592594 21627 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:41649
I20260929 06:38:34.592674 21755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:41649 every 8 connection(s)
I20260929 06:38:34.593014 21627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:38:34.593164 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 21627
I20260929 06:38:34.593284 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:38:34.593489 15990 external_mini_cluster.cc:1428] Setting key 827cd28d6394c6a8bd079e0205067a47
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
I20260929 06:38:34.603487 21604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:34.593772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:42979 (local address 127.15.157.190:32845)
0929 06:38:34.593821 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:34.593823 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:34.594042 (+ 219us) server_negotiation.cc:407] Connection header received
0929 06:38:34.595029 (+ 987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:34.595030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:34.595043 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:34.595108 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:34.595996 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.596481 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.598068 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.598282 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.598338 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:34.600709 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:34.600711 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:34.600711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:34.600737 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:34.602287 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:34.602684 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:34.602686 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:34.602686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:34.602745 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:34.602981 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:34.602982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:34.602982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:34.603078 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:34.603127 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:34.603354 (+ 227us) server_negotiation.cc:299] Negotiation successful
0929 06:38:34.603419 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:38:34.603628 21758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:34.593766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:32845 (local address 127.15.157.129:42979)
0929 06:38:34.593912 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:34.593955 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:34.594915 (+ 960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:34.595170 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:34.595174 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:34.595617 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:34.595895 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:34.595901 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.596571 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.596572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:34.597941 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:34.597944 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.598371 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.598372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:34.598532 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:34.599031 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:34.599041 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:34.600610 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:34.602355 (+ 1745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:34.602360 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:34.602362 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:34.602571 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:34.602825 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:34.602826 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:34.602826 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:34.602922 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:34.603131 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:34.603134 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:34.603245 (+ 111us) client_negotiation.cc:769] Sending connection context
0929 06:38:34.603327 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 06:38:34.603441 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":79,"threads_started":1}
I20260929 06:38:34.604203 21756 heartbeater.cc:347] Connected to a master server at 127.15.157.190:32845
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
I20260929 06:38:34.604324 21756 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:34.604507 21756 heartbeater.cc:511] Master 127.15.157.190:32845 requested a full tablet report, sending...
I20260929 06:38:34.605073 21565 ts_manager.cc:194] Registered new tserver with Master: 41459255f7d04e179c0eb0509d140ce1 (127.15.157.129:41649)
I20260929 06:38:34.605965 21565 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:42979
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:38:34.620712 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:32845
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:44739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:34.699932 21761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:34.700121 21761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:34.700143 21761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:34.701292 21761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:34.701332 21761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:34.701357 21761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:34.702802 21761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:44739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:32845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:34.702979 21761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:34.703136 21761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:34.707908 21767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:34.707923 21766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:34.708010 21761 server_base.cc:1034] running on GCE node
W20260929 06:38:34.707923 21769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:34.708333 21761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:34.708559 21761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:34.709700 21761 hybrid_clock.cc:648] HybridClock initialized: now 1790663914709691 us; error 35 us; skew 500 ppm
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:34.712086 21761 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:38:34.712529 21761 webserver.cc:460] Webserver started at http://127.15.157.130:34293/ using document root <none> and password file <none>
I20260929 06:38:34.712749 21761 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:34.712793 21761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:34.712954 21761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:34.713955 21761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "fcc3491f3930437ea54b29b326384bce"
format_stamp: "Formatted at 2026-09-29 06:38:34 on dist-test-slave-ltw5"
server_key: "1075f2b608f318a8fe282ddfcac0d720"
server_key_iv: "65060b2d60b60e374a4d5aa4e0932a42"
server_key_version: "encryptionkey@0"
I20260929 06:38:34.714375 21761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "fcc3491f3930437ea54b29b326384bce"
format_stamp: "Formatted at 2026-09-29 06:38:34 on dist-test-slave-ltw5"
server_key: "1075f2b608f318a8fe282ddfcac0d720"
server_key_iv: "65060b2d60b60e374a4d5aa4e0932a42"
server_key_version: "encryptionkey@0"
I20260929 06:38:34.715639 21761 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:34.716307 21776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:34.716483 21761 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:34.716548 21761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "fcc3491f3930437ea54b29b326384bce"
format_stamp: "Formatted at 2026-09-29 06:38:34 on dist-test-slave-ltw5"
server_key: "1075f2b608f318a8fe282ddfcac0d720"
server_key_iv: "65060b2d60b60e374a4d5aa4e0932a42"
server_key_version: "encryptionkey@0"
I20260929 06:38:34.716627 21761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:34.742069 21761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:34.743906 21761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:34.744064 21761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:34.744290 21761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:34.744603 21761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:34.744658 21761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:34.744700 21761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:34.744728 21761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:34.750384 21761 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:44503
I20260929 06:38:34.750432 21889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:44503 every 8 connection(s)
I20260929 06:38:34.750732 21761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:38:34.755287 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 21761
I20260929 06:38:34.755414 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:38:34.755615 15990 external_mini_cluster.cc:1428] Setting key 3a5fd89c22d93282d40207f5e0eafd0a
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:34.759956 21604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:34.751422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:44341 (local address 127.15.157.190:32845)
0929 06:38:34.751505 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:34.751508 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:34.751657 (+ 149us) server_negotiation.cc:407] Connection header received
0929 06:38:34.752584 (+ 927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:34.752585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:34.752596 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:34.752652 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:34.753220 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.753715 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.754724 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.754902 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.754952 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:34.757126 (+ 2174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:34.757128 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:34.757128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:34.757135 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:34.758593 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:34.759004 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:34.759005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:34.759006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:34.759067 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:34.759311 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:34.759312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:34.759312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:34.759426 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:34.759503 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:34.759784 (+ 281us) server_negotiation.cc:299] Negotiation successful
0929 06:38:34.759867 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260929 06:38:34.760175 21892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:34.751377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:32845 (local address 127.15.157.130:44341)
0929 06:38:34.751526 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:34.751563 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:34.752436 (+ 873us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:34.752707 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:34.752710 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:34.752960 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:34.753144 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:34.753148 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.753793 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.753794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:34.754649 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:34.754651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.754971 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.754972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:34.755068 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:34.755653 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:34.755661 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:34.757019 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:34.758686 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:34.758693 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:34.758695 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:34.758918 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:34.759135 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:34.759136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:34.759136 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:34.759246 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:34.759504 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:34.759511 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:34.759643 (+ 132us) client_negotiation.cc:769] Sending connection context
0929 06:38:34.759750 (+ 107us) client_negotiation.cc:240] Negotiation successful
0929 06:38:34.759908 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":89,"threads_started":1}
I20260929 06:38:34.760667 21890 heartbeater.cc:347] Connected to a master server at 127.15.157.190:32845
I20260929 06:38:34.760747 21890 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:34.760931 21890 heartbeater.cc:511] Master 127.15.157.190:32845 requested a full tablet report, sending...
I20260929 06:38:34.761351 21565 ts_manager.cc:194] Registered new tserver with Master: fcc3491f3930437ea54b29b326384bce (127.15.157.130:44503)
I20260929 06:38:34.761850 21565 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:44341
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:38:34.780124 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:32845
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:44739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:34.859259 21895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:34.859462 21895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:34.859485 21895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:34.860646 21895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:34.860687 21895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:34.860713 21895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:34.862169 21895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:44739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:32845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:34.862347 21895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:34.862517 21895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:34.867343 21900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:34.867353 21903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:34.867373 21895 server_base.cc:1034] running on GCE node
W20260929 06:38:34.867344 21901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:34.867861 21895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:34.868075 21895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:34.869248 21895 hybrid_clock.cc:648] HybridClock initialized: now 1790663914869234 us; error 30 us; skew 500 ppm
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:34.872009 21895 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:38:34.872521 21895 webserver.cc:460] Webserver started at http://127.15.157.131:42495/ using document root <none> and password file <none>
I20260929 06:38:34.872759 21895 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:34.872804 21895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:34.872949 21895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:34.873973 21895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "68a3c5e8ad58472a960e5e19fb633c0d"
format_stamp: "Formatted at 2026-09-29 06:38:34 on dist-test-slave-ltw5"
server_key: "3fcf8e81a5cf18d2dfcafd50cd272e45"
server_key_iv: "d56c2db3e79515352343c43177d5a584"
server_key_version: "encryptionkey@0"
I20260929 06:38:34.874402 21895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "68a3c5e8ad58472a960e5e19fb633c0d"
format_stamp: "Formatted at 2026-09-29 06:38:34 on dist-test-slave-ltw5"
server_key: "3fcf8e81a5cf18d2dfcafd50cd272e45"
server_key_iv: "d56c2db3e79515352343c43177d5a584"
server_key_version: "encryptionkey@0"
I20260929 06:38:34.875684 21895 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:34.876374 21910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:34.876541 21895 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:34.876638 21895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "68a3c5e8ad58472a960e5e19fb633c0d"
format_stamp: "Formatted at 2026-09-29 06:38:34 on dist-test-slave-ltw5"
server_key: "3fcf8e81a5cf18d2dfcafd50cd272e45"
server_key_iv: "d56c2db3e79515352343c43177d5a584"
server_key_version: "encryptionkey@0"
I20260929 06:38:34.876730 21895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:34.890250 21895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:34.892486 21895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:34.892647 21895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:34.892882 21895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:34.893181 21895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:34.893235 21895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:34.893277 21895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:34.893306 21895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:34.899077 21895 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:37985
I20260929 06:38:34.899147 22023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:37985 every 8 connection(s)
I20260929 06:38:34.899466 21895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:38:34.904580 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 21895
I20260929 06:38:34.904663 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:38:34.904855 15990 external_mini_cluster.cc:1428] Setting key 15e5a4ab8fe532f8f5e0d77ae70d046f
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:34.908588 21604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:34.900145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:58493 (local address 127.15.157.190:32845)
0929 06:38:34.900184 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:34.900186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:34.900423 (+ 237us) server_negotiation.cc:407] Connection header received
0929 06:38:34.901345 (+ 922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:34.901347 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:34.901357 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:34.901409 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:34.902046 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.902534 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.903536 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.903734 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.903822 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:34.905941 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:34.905942 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:34.905942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:34.905948 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:34.907530 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:34.907878 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:34.907879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:34.907879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:34.907925 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:34.908133 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:34.908133 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:34.908133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:34.908227 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:34.908274 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:34.908475 (+ 201us) server_negotiation.cc:299] Negotiation successful
0929 06:38:34.908529 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:38:34.908838 22026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:34.900138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:32845 (local address 127.15.157.131:58493)
0929 06:38:34.900307 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:34.900340 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:34.901236 (+ 896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:34.901487 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:34.901491 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:34.901745 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:34.901925 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:34.901929 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.902637 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.902638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:34.903433 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:34.903435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.903842 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.903844 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:34.903961 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:34.904436 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:34.904444 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:34.905866 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:34.907598 (+ 1732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:34.907603 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:34.907604 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:34.907815 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:34.907988 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:34.907989 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:34.907989 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:34.908082 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:34.908280 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:34.908283 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:34.908387 (+ 104us) client_negotiation.cc:769] Sending connection context
0929 06:38:34.908466 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 06:38:34.908573 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
I20260929 06:38:34.909227 22024 heartbeater.cc:347] Connected to a master server at 127.15.157.190:32845
I20260929 06:38:34.909324 22024 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:34.909451 22024 heartbeater.cc:511] Master 127.15.157.190:32845 requested a full tablet report, sending...
I20260929 06:38:34.909813 21565 ts_manager.cc:194] Registered new tserver with Master: 68a3c5e8ad58472a960e5e19fb633c0d (127.15.157.131:37985)
I20260929 06:38:34.910200 21565 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:58493
I20260929 06:38:34.916491 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/test-admin.keytab.
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:34.932488 15990 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260929 06:38:34.934033 22031 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:34.933300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43344 (local address 127.15.157.129:41649)
0929 06:38:34.933449 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:34.933454 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:34.933464 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:38:34.933496 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:34.933498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:34.933510 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:34.933591 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:34.933927 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43344: BlockingRecv error: recv got EOF from 127.0.0.1:43344 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":64,"threads_started":1}
W20260929 06:38:34.934166 15990 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/krb5cc' of type FILE
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:34.935122 15990 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:34.935963 15990 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.129@KRBTEST.COM
I20260929 06:38:34.943426 22031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:34.936455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43348 (local address 127.15.157.129:41649)
0929 06:38:34.936509 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:34.936510 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:34.936560 (+ 50us) server_negotiation.cc:407] Connection header received
0929 06:38:34.936602 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:34.936602 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:34.936611 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:34.936657 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:34.937014 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.937713 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.938520 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.938842 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.938899 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:34.940801 (+ 1902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:34.940807 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:34.940807 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:34.940813 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:34.942449 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:34.942753 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:34.942756 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:34.942756 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:34.942810 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:34.942947 (+ 137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:34.942948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:34.942948 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:34.943055 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:34.943146 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:34.943204 (+ 58us) server_negotiation.cc:299] Negotiation successful
0929 06:38:34.943261 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260929 06:38:34.945071 22031 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:34.944575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43350 (local address 127.15.157.129:41649)
0929 06:38:34.944607 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:34.944608 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:34.944641 (+ 33us) server_negotiation.cc:407] Connection header received
0929 06:38:34.944708 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:34.944709 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:34.944717 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:34.944767 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:34.945024 (+ 257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43350: BlockingRecv error: recv got EOF from 127.0.0.1:43350 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 06:38:34.945180 15990 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/krb5cc' of type FILE
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:34.946153 15990 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:34.946931 15990 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.129@KRBTEST.COM
I20260929 06:38:34.952924 22031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:34.947378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43352 (local address 127.15.157.129:41649)
0929 06:38:34.947428 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:34.947430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:34.947471 (+ 41us) server_negotiation.cc:407] Connection header received
0929 06:38:34.947505 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:34.947506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:34.947513 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:34.947557 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:34.947854 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.948309 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.948918 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.949094 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.949141 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:34.950955 (+ 1814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:34.950956 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:34.950956 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:34.950961 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:34.952054 (+ 1093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:34.952341 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:34.952341 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:34.952342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:34.952384 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:34.952535 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:34.952535 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:34.952535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:34.952610 (+ 75us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:34.952674 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:34.952751 (+ 77us) server_negotiation.cc:299] Negotiation successful
0929 06:38:34.952802 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260929 06:38:34.954442 22031 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:34.953889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43362 (local address 127.15.157.129:41649)
0929 06:38:34.953922 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:34.953924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:34.953968 (+ 44us) server_negotiation.cc:407] Connection header received
0929 06:38:34.954047 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:34.954048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:34.954058 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:34.954124 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:34.954398 (+ 274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43362: BlockingRecv error: recv got EOF from 127.0.0.1:43362 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260929 06:38:34.954548 15990 init.cc:244] Error while opening credential cache '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663890058284-15990-0/krb5kdc/krb5cc)
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:34.955425 15990 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:34.956218 15990 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 29 06:38:34 dist-test-slave-ltw5 krb5kdc[21520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.129@KRBTEST.COM
I20260929 06:38:34.962136 22031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:34.956657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43378 (local address 127.15.157.129:41649)
0929 06:38:34.956721 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:34.956723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:34.956773 (+ 50us) server_negotiation.cc:407] Connection header received
0929 06:38:34.956811 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:34.956811 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:34.956818 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:34.956861 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:34.957160 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.957582 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.958287 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:34.958453 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:34.958497 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:34.960263 (+ 1766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:34.960264 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:34.960265 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:34.960270 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:34.961326 (+ 1056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:34.961603 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:34.961603 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:34.961604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:34.961645 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:34.961781 (+ 136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:34.961781 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:34.961781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:34.961850 (+ 69us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:34.961920 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:34.961984 (+ 64us) server_negotiation.cc:299] Negotiation successful
0929 06:38:34.962083 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 06:38:34.962711 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 21627
I20260929 06:38:34.967492 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 21761
I20260929 06:38:34.971638 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 21895
I20260929 06:38:34.975800 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 21533
2026-09-29T06:38:34Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1836 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:35 dist-test-slave-ltw5 krb5kdc[22044](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:35 dist-test-slave-ltw5 krb5kdc[22044](info): set up 2 sockets
Sep 29 06:38:35 dist-test-slave-ltw5 krb5kdc[22044](info): commencing operation
krb5kdc: starting...
W20260929 06:38:36.006400 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:36Z Disabled control of system clock
WARNING: no policy specified for oryx/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.190.keytab.
Entry for principal oryx/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.190.keytab.
I20260929 06:38:36.124850 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45285
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.190.keytab
--principal=oryx/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:40403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:45285
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:36.207023 22057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:36.207270 22057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:36.207309 22057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:36.208455 22057 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:36.208520 22057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:36.208545 22057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:36.208578 22057 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:36.208602 22057 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:36.210127 22057 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:40403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:45285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.190.keytab
--principal=oryx/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:36.210407 22057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:36.210630 22057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:36.215512 22062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:36.215534 22063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:36.215534 22065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:36.215978 22057 server_base.cc:1034] running on GCE node
I20260929 06:38:36.216224 22057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:36.216507 22057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:36.217640 22057 hybrid_clock.cc:648] HybridClock initialized: now 1790663916217621 us; error 33 us; skew 500 ppm
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:36.223922 22057 init.cc:377] Logged in from keytab as oryx/127.15.157.190@KRBTEST.COM (short username oryx)
I20260929 06:38:36.224356 22057 webserver.cc:460] Webserver started at http://127.15.157.190:35799/ using document root <none> and password file <none>
I20260929 06:38:36.224589 22057 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:36.224658 22057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:36.224807 22057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:36.225853 22057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "4540dd34fb5d4c96b0e4a7ebea42d091"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "c769bfbc5a98816bde2b3de6aabeaf59"
server_key_iv: "d543e062cbfdc4a8259de41a601cf8e8"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.226229 22057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "4540dd34fb5d4c96b0e4a7ebea42d091"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "c769bfbc5a98816bde2b3de6aabeaf59"
server_key_iv: "d543e062cbfdc4a8259de41a601cf8e8"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.227516 22057 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:36.228212 22072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.228377 22057 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:36.228475 22057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "4540dd34fb5d4c96b0e4a7ebea42d091"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "c769bfbc5a98816bde2b3de6aabeaf59"
server_key_iv: "d543e062cbfdc4a8259de41a601cf8e8"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.228556 22057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:36.252852 22057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:36.254990 22057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:36.255170 22057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:36.259089 22057 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:45285
I20260929 06:38:36.259119 22124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:45285 every 8 connection(s)
I20260929 06:38:36.259526 22057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:36.260514 22125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:36.262820 22125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091: Bootstrap starting.
I20260929 06:38:36.263392 22125 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:36.263675 22125 log.cc:824] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:36.264460 22125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091: No bootstrap required, opened a new log
I20260929 06:38:36.266001 22125 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } }
I20260929 06:38:36.266218 22125 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:36.266243 22125 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4540dd34fb5d4c96b0e4a7ebea42d091, State: Initialized, Role: FOLLOWER
I20260929 06:38:36.266408 22125 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } }
I20260929 06:38:36.266469 22125 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:36.266489 22125 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:36.266551 22125 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:36.267328 22125 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } }
I20260929 06:38:36.267409 22125 leader_election.cc:302] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4540dd34fb5d4c96b0e4a7ebea42d091; no voters:
I20260929 06:38:36.267549 22125 leader_election.cc:288] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:36.267575 22128 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:36.267694 22128 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [term 1 LEADER]: Becoming Leader. State: Replica: 4540dd34fb5d4c96b0e4a7ebea42d091, State: Running, Role: LEADER
I20260929 06:38:36.267774 22128 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } }
I20260929 06:38:36.267812 22125 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:36.268124 22130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4540dd34fb5d4c96b0e4a7ebea42d091. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } }
I20260929 06:38:36.268138 22129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } }
I20260929 06:38:36.268304 22129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:36.268489 22130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:36.268733 22136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:36.269239 22136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:36.269624 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 22057
I20260929 06:38:36.269769 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:36.269958 15990 external_mini_cluster.cc:1428] Setting key ed43959670b2ab41f40117cc80948573
I20260929 06:38:36.270915 22136 catalog_manager.cc:1347] Generated new cluster ID: c8ae0126f5d44dd094c05a68c82a1f71
I20260929 06:38:36.270967 22136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
I20260929 06:38:36.280803 22136 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:36.281342 22148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.270538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57114 (local address 127.15.157.190:45285)
0929 06:38:36.270708 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:36.270717 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:36.270749 (+ 32us) server_negotiation.cc:407] Connection header received
0929 06:38:36.270860 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:36.270868 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:36.270924 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:36.271068 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:36.271821 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.273136 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.274251 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.274840 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.274929 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.277658 (+ 2729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:36.277662 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:36.277663 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:36.277675 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:36.279665 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.280043 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.280046 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.280046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.280150 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.280374 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.280375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.280375 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.280648 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:36.280806 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:36.280977 (+ 171us) server_negotiation.cc:299] Negotiation successful
0929 06:38:36.281112 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":84,"threads_started":1}
I20260929 06:38:36.281378 22136 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:36.285853 22136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091: Generated new TSK 0
I20260929 06:38:36.286022 22136 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.129.keytab.
Entry for principal oryx/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.129.keytab.
I20260929 06:38:36.312259 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45285
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.129.keytab
--principal=oryx/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:40403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:36.391731 22151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:36.391992 22151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:36.392033 22151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:36.393226 22151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:36.393294 22151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:36.393340 22151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:36.394891 22151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:40403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.129.keytab
--principal=oryx/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:36.395161 22151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:36.395394 22151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:36.402480 22156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:36.402570 22151 server_base.cc:1034] running on GCE node
W20260929 06:38:36.402510 22159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:36.402635 22157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:36.402853 22151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:36.403131 22151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:36.404279 22151 hybrid_clock.cc:648] HybridClock initialized: now 1790663916404271 us; error 30 us; skew 500 ppm
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:36.406772 22151 init.cc:377] Logged in from keytab as oryx/127.15.157.129@KRBTEST.COM (short username oryx)
I20260929 06:38:36.407229 22151 webserver.cc:460] Webserver started at http://127.15.157.129:41057/ using document root <none> and password file <none>
I20260929 06:38:36.407459 22151 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:36.407526 22151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:36.407665 22151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:36.408706 22151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "c6474efaac22405e840b064c9f85f2bd"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "dffd5423e3e6ad1f6c94bd63d1ee68de"
server_key_iv: "c4965a2d6b3a4686fec522ab19fd71c9"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.409073 22151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "c6474efaac22405e840b064c9f85f2bd"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "dffd5423e3e6ad1f6c94bd63d1ee68de"
server_key_iv: "c4965a2d6b3a4686fec522ab19fd71c9"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.410426 22151 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:38:36.411141 22166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.411310 22151 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:36.411406 22151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "c6474efaac22405e840b064c9f85f2bd"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "dffd5423e3e6ad1f6c94bd63d1ee68de"
server_key_iv: "c4965a2d6b3a4686fec522ab19fd71c9"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.411489 22151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:36.424443 22151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:36.426240 22151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:36.426393 22151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:36.426608 22151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:36.426914 22151 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:36.426972 22151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.427012 22151 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:36.427040 22151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.433179 22151 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:39687
I20260929 06:38:36.433224 22279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:39687 every 8 connection(s)
I20260929 06:38:36.433540 22151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:38:36.437196 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 22151
I20260929 06:38:36.437294 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:38:36.437474 15990 external_mini_cluster.cc:1428] Setting key f5d77e09c9cc873546be9749fbc442f4
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
I20260929 06:38:36.443468 22282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.434285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.129:44111)
0929 06:38:36.434445 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:36.434479 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:36.434965 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:36.435176 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:36.435180 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:36.435769 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:36.435955 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.435959 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.436595 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.436596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.437730 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.437733 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.438244 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.438245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.438381 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.438949 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:36.438958 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:36.440284 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:36.442154 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.442160 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.442161 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.442382 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.442600 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.442600 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.442601 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.442701 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.442992 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:36.442996 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:36.443103 (+ 107us) client_negotiation.cc:769] Sending connection context
0929 06:38:36.443193 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 06:38:36.443306 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":82,"threads_started":1}
I20260929 06:38:36.443475 22148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.434309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:44111 (local address 127.15.157.190:45285)
0929 06:38:36.434370 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:36.434372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:36.434567 (+ 195us) server_negotiation.cc:407] Connection header received
0929 06:38:36.435048 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:36.435049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:36.435062 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:36.435121 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:36.436030 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.436522 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.437825 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.438138 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.438235 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.440357 (+ 2122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:36.440358 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:36.440359 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:36.440367 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:36.442074 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.442461 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.442462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.442462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.442529 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.442767 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.442768 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.442768 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.442922 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:36.443001 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:36.443232 (+ 231us) server_negotiation.cc:299] Negotiation successful
0929 06:38:36.443336 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:38:36.444020 22280 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45285
I20260929 06:38:36.444129 22280 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:36.444306 22280 heartbeater.cc:511] Master 127.15.157.190:45285 requested a full tablet report, sending...
I20260929 06:38:36.444866 22089 ts_manager.cc:194] Registered new tserver with Master: c6474efaac22405e840b064c9f85f2bd (127.15.157.129:39687)
I20260929 06:38:36.445812 22089 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:44111
WARNING: no policy specified for oryx/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.130.keytab.
Entry for principal oryx/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.130.keytab.
I20260929 06:38:36.462771 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45285
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.130.keytab
--principal=oryx/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:40403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:36.545884 22285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:36.546128 22285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:36.546165 22285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:36.547304 22285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:36.547365 22285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:36.547408 22285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:36.548831 22285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:40403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.130.keytab
--principal=oryx/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:36.549081 22285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:36.549305 22285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:36.554169 22291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:36.554180 22293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:36.554169 22290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:36.554405 22285 server_base.cc:1034] running on GCE node
I20260929 06:38:36.554625 22285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:36.554814 22285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:36.555948 22285 hybrid_clock.cc:648] HybridClock initialized: now 1790663916555937 us; error 28 us; skew 500 ppm
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:36.558372 22285 init.cc:377] Logged in from keytab as oryx/127.15.157.130@KRBTEST.COM (short username oryx)
I20260929 06:38:36.558835 22285 webserver.cc:460] Webserver started at http://127.15.157.130:39295/ using document root <none> and password file <none>
I20260929 06:38:36.559051 22285 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:36.559116 22285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:36.559265 22285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:36.560274 22285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "be05363333594e1ea376d3017d0a3c0e"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "d419cfce8724db85d31dcf48857fbcb5"
server_key_iv: "69ab951f0eb4fdb322790e4a1aeedeff"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.560621 22285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "be05363333594e1ea376d3017d0a3c0e"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "d419cfce8724db85d31dcf48857fbcb5"
server_key_iv: "69ab951f0eb4fdb322790e4a1aeedeff"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.561902 22285 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:38:36.562610 22300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.562780 22285 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.562873 22285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "be05363333594e1ea376d3017d0a3c0e"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "d419cfce8724db85d31dcf48857fbcb5"
server_key_iv: "69ab951f0eb4fdb322790e4a1aeedeff"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.562952 22285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:36.575222 22285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:36.576968 22285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:36.577131 22285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:36.577353 22285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:36.577647 22285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:36.577698 22285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.577737 22285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:36.577757 22285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.583425 22285 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:42155
I20260929 06:38:36.583465 22413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:42155 every 8 connection(s)
I20260929 06:38:36.583797 22285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:38:36.587224 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 22285
I20260929 06:38:36.587327 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:38:36.587491 15990 external_mini_cluster.cc:1428] Setting key fe33e5e4ad0ef1aff937e562af55969f
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
I20260929 06:38:36.594008 22148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.584525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:45409 (local address 127.15.157.190:45285)
0929 06:38:36.584593 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:36.584595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:36.584791 (+ 196us) server_negotiation.cc:407] Connection header received
0929 06:38:36.585242 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:36.585242 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:36.585253 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:36.585310 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:36.586276 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.586764 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.588050 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.588299 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.588352 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.591044 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:36.591045 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:36.591046 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:36.591052 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:36.592519 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.593041 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.593042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.593043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.593101 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.593394 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.593395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.593395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.593494 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:36.593542 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:36.593884 (+ 342us) server_negotiation.cc:299] Negotiation successful
0929 06:38:36.593947 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 06:38:36.594322 22416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.584507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.130:45409)
0929 06:38:36.584665 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:36.584699 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:36.585158 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:36.585372 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:36.585376 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:36.585932 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:36.586187 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.586191 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.586836 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.586837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.587953 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.587955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.588380 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.588381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.588523 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.589028 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:36.589037 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:36.590956 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:36.592605 (+ 1649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.592612 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.592615 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.592952 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.593168 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.593169 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.593169 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.593326 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.593559 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:36.593565 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:36.593740 (+ 175us) client_negotiation.cc:769] Sending connection context
0929 06:38:36.593858 (+ 118us) client_negotiation.cc:240] Negotiation successful
0929 06:38:36.594052 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":85,"threads_started":1}
I20260929 06:38:36.594872 22414 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45285
I20260929 06:38:36.594982 22414 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:36.595175 22414 heartbeater.cc:511] Master 127.15.157.190:45285 requested a full tablet report, sending...
I20260929 06:38:36.595546 22089 ts_manager.cc:194] Registered new tserver with Master: be05363333594e1ea376d3017d0a3c0e (127.15.157.130:42155)
I20260929 06:38:36.596087 22089 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:45409
WARNING: no policy specified for oryx/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.131.keytab.
Entry for principal oryx/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.131.keytab.
I20260929 06:38:36.613022 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45285
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.131.keytab
--principal=oryx/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:40403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:36.691331 22419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:36.691591 22419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:36.691630 22419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:36.692786 22419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:36.692859 22419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:36.692902 22419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:36.694373 22419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:40403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.131.keytab
--principal=oryx/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:36.694638 22419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:36.694877 22419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:36.699980 22427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:36.700031 22424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:36.700070 22425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:36.700331 22419 server_base.cc:1034] running on GCE node
I20260929 06:38:36.700546 22419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:36.700738 22419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:36.701870 22419 hybrid_clock.cc:648] HybridClock initialized: now 1790663916701857 us; error 27 us; skew 500 ppm
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:36.704236 22419 init.cc:377] Logged in from keytab as oryx/127.15.157.131@KRBTEST.COM (short username oryx)
I20260929 06:38:36.704632 22419 webserver.cc:460] Webserver started at http://127.15.157.131:42005/ using document root <none> and password file <none>
I20260929 06:38:36.704862 22419 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:36.704926 22419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:36.705065 22419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:36.706120 22419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "7be196a581b047d29464880bf68c01d0"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "57740160a93f67d97d8ff6ca694f2f21"
server_key_iv: "778f515a35ca036fbf20a62cb033920a"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.706475 22419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "7be196a581b047d29464880bf68c01d0"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "57740160a93f67d97d8ff6ca694f2f21"
server_key_iv: "778f515a35ca036fbf20a62cb033920a"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.707738 22419 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:36.708402 22434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.708561 22419 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:36.708659 22419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "7be196a581b047d29464880bf68c01d0"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "57740160a93f67d97d8ff6ca694f2f21"
server_key_iv: "778f515a35ca036fbf20a62cb033920a"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.708729 22419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:36.723048 22419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:36.724810 22419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:36.724967 22419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:36.725183 22419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:36.725488 22419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:36.725538 22419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.725579 22419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:36.725605 22419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.731462 22419 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:46633
I20260929 06:38:36.731503 22547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:46633 every 8 connection(s)
I20260929 06:38:36.731838 22419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:38:36.737411 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 22419
I20260929 06:38:36.737516 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
I20260929 06:38:36.737707 15990 external_mini_cluster.cc:1428] Setting key 7d5e2b4a83154df357a5dce04365050b
I20260929 06:38:36.740661 22148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.732480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:58219 (local address 127.15.157.190:45285)
0929 06:38:36.732543 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:36.732545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:36.732754 (+ 209us) server_negotiation.cc:407] Connection header received
0929 06:38:36.733279 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:36.733280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:36.733294 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:36.733345 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:36.734343 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.734849 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.735842 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.736055 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.736142 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.738346 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:36.738348 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:36.738348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:36.738356 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:36.739582 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.739933 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.739934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.739934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.739980 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.740178 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.740179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.740179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.740274 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:36.740323 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:36.740545 (+ 222us) server_negotiation.cc:299] Negotiation successful
0929 06:38:36.740602 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 06:38:36.740825 22550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.732504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.131:58219)
0929 06:38:36.732640 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:36.732674 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:36.733168 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:36.733411 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:36.733415 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:36.733983 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:36.734247 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.734253 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.734947 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.734948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.735754 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.735756 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.736151 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.736152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.736273 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.736698 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:36.736707 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:36.738245 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:36.739646 (+ 1401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.739651 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.739653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.739873 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.740037 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.740038 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.740038 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.740130 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.740325 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:36.740329 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:36.740437 (+ 108us) client_negotiation.cc:769] Sending connection context
0929 06:38:36.740520 (+ 83us) client_negotiation.cc:240] Negotiation successful
0929 06:38:36.740631 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":64,"threads_started":1}
I20260929 06:38:36.741255 22548 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45285
I20260929 06:38:36.741349 22548 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:36.741521 22548 heartbeater.cc:511] Master 127.15.157.190:45285 requested a full tablet report, sending...
I20260929 06:38:36.741933 22089 ts_manager.cc:194] Registered new tserver with Master: 7be196a581b047d29464880bf68c01d0 (127.15.157.131:46633)
I20260929 06:38:36.742326 22089 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:58219
I20260929 06:38:36.749440 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.15.157.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.157.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.157.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.189.keytab.
Entry for principal oryx/127.15.157.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.189.keytab.
I20260929 06:38:36.773212 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.189:45837
--webserver_interface=127.15.157.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.189.keytab
--principal=oryx/127.15.157.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:40403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:45285,127.15.157.189:45837
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:36.853765 22553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:36.854024 22553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:36.854084 22553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:36.855261 22553 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:36.855333 22553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:36.855356 22553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:36.855377 22553 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:36.855408 22553 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:36.856911 22553 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:40403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:45285,127.15.157.189:45837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.189.keytab
--principal=oryx/127.15.157.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.189:45837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.157.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
W20260929 06:38:36.857059 22553 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.15.157.190:45285,127.15.157.189:45837'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260929 06:38:36.857228 22553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:36.857458 22553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:36.862291 22561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:36.862298 22558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:36.862344 22559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:36.862509 22553 server_base.cc:1034] running on GCE node
I20260929 06:38:36.862766 22553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:36.863051 22553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:36.864218 22553 hybrid_clock.cc:648] HybridClock initialized: now 1790663916864198 us; error 51 us; skew 500 ppm
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:36.866897 22553 init.cc:377] Logged in from keytab as oryx/127.15.157.189@KRBTEST.COM (short username oryx)
I20260929 06:38:36.867446 22553 webserver.cc:460] Webserver started at http://127.15.157.189:35009/ using document root <none> and password file <none>
I20260929 06:38:36.867702 22553 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:36.867748 22553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:36.867849 22553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:36.868978 22553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/data/instance:
uuid: "2fe578c668a549c58263b9d014a0b76f"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "6ba4a3baa8d8428c9f62defee1441aac"
server_key_iv: "f9225b7ba878ecd0f9d36540b4a41eaa"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.869340 22553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/wal/instance:
uuid: "2fe578c668a549c58263b9d014a0b76f"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "6ba4a3baa8d8428c9f62defee1441aac"
server_key_iv: "f9225b7ba878ecd0f9d36540b4a41eaa"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.870692 22553 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260929 06:38:36.871393 22568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.871574 22553 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:36.871660 22553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/wal
uuid: "2fe578c668a549c58263b9d014a0b76f"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "6ba4a3baa8d8428c9f62defee1441aac"
server_key_iv: "f9225b7ba878ecd0f9d36540b4a41eaa"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.871732 22553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:36.886188 22553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:36.888073 22553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:36.888221 22553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:36.892306 22553 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.189:45837
I20260929 06:38:36.892386 22620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.189:45837 every 8 connection(s)
I20260929 06:38:36.892709 22553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/data/info.pb
I20260929 06:38:36.893713 22621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:36.895316 22621 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:36.897845 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 22553
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.189@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.157.189@KRBTEST.COM
I20260929 06:38:36.904556 22148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.896049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57120 (local address 127.15.157.190:45285)
0929 06:38:36.896128 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:36.896131 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:36.896366 (+ 235us) server_negotiation.cc:407] Connection header received
0929 06:38:36.896828 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:36.896829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:36.896839 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:36.896892 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:36.897474 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.898061 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.899154 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.899428 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.899481 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.901713 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:36.901715 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:36.901715 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:36.901723 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:36.903123 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.903514 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.903515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.903516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.903577 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.903874 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.903875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.903875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.904020 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:36.904115 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:36.904424 (+ 309us) server_negotiation.cc:299] Negotiation successful
0929 06:38:36.904491 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 06:38:36.904810 22623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.895999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.0.0.1:57120)
0929 06:38:36.896203 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:36.896255 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:36.896743 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:36.896947 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:36.896951 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:36.897196 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:36.897393 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.897396 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.898155 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.898158 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.899060 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.899062 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.899506 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.899507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.899634 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.900125 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:36.900134 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:36.901626 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:36.903203 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.903208 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.903210 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.903414 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.903645 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.903646 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.903646 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.903796 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.904113 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:36.904117 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:36.904274 (+ 157us) client_negotiation.cc:769] Sending connection context
0929 06:38:36.904398 (+ 124us) client_negotiation.cc:240] Negotiation successful
0929 06:38:36.904562 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":97,"threads_started":1}
I20260929 06:38:36.905416 22621 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:36.907068 22625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.898370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33778 (local address 127.15.157.189:45837)
0929 06:38:36.898525 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:36.898530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:36.898565 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:38:36.898593 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:36.898594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:36.898610 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:36.898682 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:36.899283 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.900207 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.900914 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.901221 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.901305 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.903841 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:36.903846 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:36.903846 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:36.903852 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:36.905923 (+ 2071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.906336 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.906338 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.906339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.906386 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.906575 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.906576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.906576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.906687 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:36.906802 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:36.906898 (+ 96us) server_negotiation.cc:299] Negotiation successful
0929 06:38:36.906950 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":91,"threads_started":1}
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.189@KRBTEST.COM for oryx/127.15.157.189@KRBTEST.COM
I20260929 06:38:36.912150 22623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.905674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45837 (local address 127.0.0.1:33780)
0929 06:38:36.905708 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:36.905719 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:36.905756 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:36.905974 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:36.905975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:36.906120 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:36.906159 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.906160 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.907008 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.907008 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.907694 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.907705 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.908034 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.908034 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.908081 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.908376 (+ 295us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:36.908379 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:36.909396 (+ 1017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:36.911400 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.911401 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.911401 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.911568 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.911720 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.911721 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.911721 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.911766 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.911939 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:36.911940 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:36.911969 (+ 29us) client_negotiation.cc:769] Sending connection context
0929 06:38:36.912009 (+ 40us) client_negotiation.cc:240] Negotiation successful
0929 06:38:36.912091 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14}
I20260929 06:38:36.912302 22626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.905704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33780 (local address 127.15.157.189:45837)
0929 06:38:36.905863 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:36.905865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:36.905871 (+ 6us) server_negotiation.cc:407] Connection header received
0929 06:38:36.905886 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:36.905887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:36.905894 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:36.905951 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:36.906225 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.906931 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.907777 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.907970 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.908024 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.909472 (+ 1448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:36.909473 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:36.909473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:36.909479 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:36.911344 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.911628 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.911628 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.911629 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.911676 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.911813 (+ 137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.911813 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.911814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.911902 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:36.911948 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:36.912031 (+ 83us) server_negotiation.cc:299] Negotiation successful
0929 06:38:36.912140 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":142,"thread_start_us":106,"threads_started":1}
I20260929 06:38:36.913491 22621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: Bootstrap starting.
I20260929 06:38:36.914307 22621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:36.914615 22621 log.cc:824] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:36.915365 22621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: No bootstrap required, opened a new log
I20260929 06:38:36.917021 22621 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } }
I20260929 06:38:36.917161 22621 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:36.917235 22621 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fe578c668a549c58263b9d014a0b76f, State: Initialized, Role: FOLLOWER
I20260929 06:38:36.917366 22621 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } }
I20260929 06:38:36.917595 22628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } } }
I20260929 06:38:36.917661 22621 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:36.917704 22628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: This master's current role is: FOLLOWER
W20260929 06:38:36.919325 22639 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:38:36.919384 22639 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:38:36.920809 22553 master_runner.cc:428] Detected that this master 2fe578c668a549c58263b9d014a0b76f is joining an existing cluster
I20260929 06:38:36.920845 22553 master_runner.cc:432] Initiating AddMaster RPC to add 127.15.157.189:45837
I20260929 06:38:36.927731 22645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.921790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.0.0.1:57132)
0929 06:38:36.921935 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:36.921946 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:36.922007 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:36.922183 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:36.922183 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:36.922323 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:36.922380 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.922381 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.923310 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.923311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.923860 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.923862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.924340 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.924340 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.924383 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.924830 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:36.924834 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:36.925122 (+ 288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:36.926849 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.926850 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.926851 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.927002 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.927205 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.927205 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.927205 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.927253 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.927499 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:36.927500 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:36.927532 (+ 32us) client_negotiation.cc:769] Sending connection context
0929 06:38:36.927580 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 06:38:36.927648 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":86,"threads_started":1}
I20260929 06:38:36.927770 22148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.921840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57132 (local address 127.15.157.190:45285)
0929 06:38:36.921884 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:36.921886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:36.921998 (+ 112us) server_negotiation.cc:407] Connection header received
0929 06:38:36.922101 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:36.922101 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:36.922113 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:36.922181 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:36.922452 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.923231 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.923938 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.924248 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.924324 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.925205 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:36.925206 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:36.925207 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:36.925214 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:36.926773 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.927078 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.927079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.927079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.927141 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.927309 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.927310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.927310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.927438 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:36.927505 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:36.927606 (+ 101us) server_negotiation.cc:299] Negotiation successful
0929 06:38:36.927680 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:38:36.934679 22645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.921834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45837 (local address 127.0.0.1:33790)
0929 06:38:36.927985 (+ 6151us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:36.927995 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:36.928261 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:36.928404 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:36.928405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:36.928542 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:36.928880 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.928883 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.929961 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.929962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.930534 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.930536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.930999 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.931000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.931068 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.931462 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:36.931467 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:36.931808 (+ 341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:36.933643 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.933644 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.933644 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.933844 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.934085 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.934086 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.934086 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.934148 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.934406 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:36.934407 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:36.934453 (+ 46us) client_negotiation.cc:769] Sending connection context
0929 06:38:36.934534 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 06:38:36.934616 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5980,"thread_start_us":72,"threads_started":1}
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.190@KRBTEST.COM for oryx/127.15.157.189@KRBTEST.COM
I20260929 06:38:36.935426 22626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.921980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33790 (local address 127.15.157.189:45837)
0929 06:38:36.922012 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:36.922032 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:36.928027 (+ 5995us) server_negotiation.cc:407] Connection header received
0929 06:38:36.928341 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:36.928341 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:36.928351 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:36.928401 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:36.928968 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.929690 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.930643 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.930930 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.930994 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.931911 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:36.931912 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:36.931913 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:36.931918 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:36.933559 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.933917 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.933918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.933919 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.933980 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.934219 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.934220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.934220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.934332 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:36.934395 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:36.935264 (+ 869us) server_negotiation.cc:299] Negotiation successful
0929 06:38:36.935342 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:36.938131 22625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.930206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33806 (local address 127.15.157.189:45837)
0929 06:38:36.930242 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:36.930244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:36.930791 (+ 547us) server_negotiation.cc:407] Connection header received
0929 06:38:36.930863 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:36.930864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:36.930873 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:36.930901 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:36.931543 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.931997 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.933039 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.933270 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.933343 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.935626 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:36.935627 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:36.935627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:36.935633 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:36.937016 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.937442 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.937443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.937443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.937487 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.937667 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.937667 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.937668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.937749 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:36.937802 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:36.937980 (+ 178us) server_negotiation.cc:299] Negotiation successful
0929 06:38:36.938075 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:36.938206 22647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.930164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45837 (local address 127.0.0.1:33806)
0929 06:38:36.930681 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:36.930723 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:36.930794 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:36.930973 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:36.930976 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:36.931355 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:36.931410 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.931412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.932077 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.932078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.932945 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.932947 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.933344 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.933345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.933417 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.933858 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:36.933863 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:36.935507 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:36.937099 (+ 1592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.937105 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.937107 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.937361 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.937549 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.937550 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.937550 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.937611 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.937813 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:36.937819 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:36.937868 (+ 49us) client_negotiation.cc:769] Sending connection context
0929 06:38:36.937958 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 06:38:36.938106 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":61,"threads_started":1}
I20260929 06:38:36.938710 22089 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.15.157.189:45837: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "2fe578c668a549c58263b9d014a0b76f"
member_type: NON_VOTER
last_known_addr {
host: "127.15.157.189"
port: 45837
}
attrs {
promote: true
}
}
dest_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091"
cas_config_opid_index: -1
I20260929 06:38:36.939021 22089 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: NON_VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: true } }
I20260929 06:38:36.939529 22649 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 2fe578c668a549c58263b9d014a0b76f (127.15.157.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: NON_VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: true } } }
I20260929 06:38:36.939743 22595 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:36.940464 22595 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 FOLLOWER]: Refusing update from remote peer 4540dd34fb5d4c96b0e4a7ebea42d091: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260929 06:38:36.940500 22649 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.15.157.189:45837
I20260929 06:38:36.940707 22553 master.cc:537] Master@127.15.157.189:45837 shutting down...
I20260929 06:38:36.940759 22649 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: NON_VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 06:38:36.941463 22074 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260929 06:38:36.941824 22648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: NON_VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: true } } }
W20260929 06:38:36.941852 22074 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 -> Peer 2fe578c668a549c58263b9d014a0b76f (127.15.157.189:45837): Couldn't send request to peer 2fe578c668a549c58263b9d014a0b76f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260929 06:38:36.942996 22648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:36.943547 22553 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:36.943629 22553 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:36.943678 22553 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: stopping tablet replica
I20260929 06:38:36.956122 22553 master.cc:552] Master@127.15.157.189:45837 shutdown complete.
I20260929 06:38:36.956192 22553 master_runner.cc:305] Clearing existing system tablet
I20260929 06:38:36.956333 22553 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:36.956393 22553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:36.956979 22553 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:36.957444 22653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.957585 22553 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:36.957645 22553 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.957679 22553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/wal
uuid: "2fe578c668a549c58263b9d014a0b76f"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "6ba4a3baa8d8428c9f62defee1441aac"
server_key_iv: "f9225b7ba878ecd0f9d36540b4a41eaa"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.958506 22553 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:36.960004 22553 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260929 06:38:36.960060 22553 log.cc:1196] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260929 06:38:36.960266 22553 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: Deleting consensus metadata
I20260929 06:38:36.960394 22553 master_runner.cc:315] Copying system tablet from 127.15.157.190:45285
I20260929 06:38:36.961035 22553 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: tablet copy: Beginning tablet copy session from remote peer at address 127.15.157.190:45285
I20260929 06:38:36.967294 22659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.961359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.0.0.1:57142)
0929 06:38:36.961474 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:36.961486 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:36.961561 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:36.961697 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:36.961698 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:36.961887 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:36.961937 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.961938 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.962702 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.962704 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.963271 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:36.963273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.963649 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.963649 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:36.963715 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.964205 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:36.964210 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:36.964508 (+ 298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:36.966255 (+ 1747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.966256 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.966256 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.966432 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.966639 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:36.966640 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:36.966640 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:36.966703 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:36.966947 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:36.966948 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:36.966993 (+ 45us) client_negotiation.cc:769] Sending connection context
0929 06:38:36.967075 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 06:38:36.967183 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":74,"threads_started":1}
I20260929 06:38:36.967291 22148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:36.961424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57142 (local address 127.15.157.190:45285)
0929 06:38:36.961476 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:36.961478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:36.961542 (+ 64us) server_negotiation.cc:407] Connection header received
0929 06:38:36.961626 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:36.961627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:36.961637 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:36.961693 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:36.962087 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.962613 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.963358 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:36.963565 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:36.963647 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:36.964605 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:36.964606 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:36.964607 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:36.964615 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:36.966169 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.966502 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.966503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.966504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.966558 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:36.966764 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:36.966765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:36.966766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:36.966883 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:36.966956 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:36.967112 (+ 156us) server_negotiation.cc:299] Negotiation successful
0929 06:38:36.967183 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 06:38:36.967846 22109 tablet_copy_service.cc:140] P 4540dd34fb5d4c96b0e4a7ebea42d091: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 2fe578c668a549c58263b9d014a0b76f ({username='oryx', principal='oryx/127.15.157.189@KRBTEST.COM'} at 127.0.0.1:57142)
I20260929 06:38:36.967954 22109 tablet_copy_service.cc:161] P 4540dd34fb5d4c96b0e4a7ebea42d091: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 2fe578c668a549c58263b9d014a0b76f at {username='oryx', principal='oryx/127.15.157.189@KRBTEST.COM'} at 127.0.0.1:57142: session id = 2fe578c668a549c58263b9d014a0b76f-00000000000000000000000000000000
I20260929 06:38:36.968673 22109 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 06:38:36.969309 22553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260929 06:38:36.970767 22553 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: tablet copy: Starting download of 0 data blocks...
I20260929 06:38:36.970918 22553 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: tablet copy: Starting download of 1 WAL segments...
I20260929 06:38:36.971832 22553 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 06:38:36.972594 22109 tablet_copy_service.cc:342] P 4540dd34fb5d4c96b0e4a7ebea42d091: Request end of tablet copy session 2fe578c668a549c58263b9d014a0b76f-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.15.157.189@KRBTEST.COM'} at 127.0.0.1:57142
I20260929 06:38:36.972652 22109 tablet_copy_service.cc:433] P 4540dd34fb5d4c96b0e4a7ebea42d091: ending tablet copy session 2fe578c668a549c58263b9d014a0b76f-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 2fe578c668a549c58263b9d014a0b76f
I20260929 06:38:36.974982 22553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:36.976158 22660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:36.976203 22661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:36.978956 22663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:36.979100 22553 server_base.cc:1034] running on GCE node
I20260929 06:38:36.979187 22553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:36.979333 22553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:36.980463 22553 hybrid_clock.cc:648] HybridClock initialized: now 1790663916980426 us; error 68 us; skew 500 ppm
Sep 29 06:38:36 dist-test-slave-ltw5 krb5kdc[22044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:36.981776 22553 init.cc:377] Logged in from keytab as oryx/127.15.157.189@KRBTEST.COM (short username oryx)
I20260929 06:38:36.982129 22553 webserver.cc:460] Webserver started at http://127.15.157.189:36449/ using document root <none> and password file <none>
I20260929 06:38:36.982254 22553 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:36.982312 22553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:36.982915 22553 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:36.983464 22670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:36.983604 22553 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:36.983655 22553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/wal
uuid: "2fe578c668a549c58263b9d014a0b76f"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "6ba4a3baa8d8428c9f62defee1441aac"
server_key_iv: "f9225b7ba878ecd0f9d36540b4a41eaa"
server_key_version: "encryptionkey@0"
I20260929 06:38:36.983718 22553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:36.993788 22553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:36.995487 22553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:36.998332 22553 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.189:45837
I20260929 06:38:36.998685 22722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.189:45837 every 8 connection(s)
I20260929 06:38:36.998723 22553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-1/data/info.pb
I20260929 06:38:36.999395 22723 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:38:36.999807 22723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: Bootstrap starting.
I20260929 06:38:37.001892 22723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:38:37.002226 22723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: Bootstrap complete.
I20260929 06:38:37.002449 22723 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: NON_VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: true } }
I20260929 06:38:37.002533 22723 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fe578c668a549c58263b9d014a0b76f, State: Initialized, Role: LEARNER
I20260929 06:38:37.002575 22723 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: NON_VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: true } }
I20260929 06:38:37.002767 22723 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:37.002768 22726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: NON_VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: true } } }
I20260929 06:38:37.002869 22726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: This master's current role is: LEARNER
I20260929 06:38:37.004163 22737 catalog_manager.cc:1259] Loaded cluster ID: c8ae0126f5d44dd094c05a68c82a1f71
I20260929 06:38:37.004207 22737 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: loading cluster ID for follower catalog manager: success
I20260929 06:38:37.005326 22737 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: acquiring CA information for follower catalog manager: success
I20260929 06:38:37.005633 22737 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:38:37.015452 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.008553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33822 (local address 127.15.157.189:45837)
0929 06:38:37.008673 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.008675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.008685 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:38:37.008709 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.008710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.008721 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.008803 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.009277 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.010297 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.011002 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.011343 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.011419 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.012673 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.012674 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.012675 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.012682 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.014343 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.014651 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.014653 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.014653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.014715 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.014893 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.014894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.014894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.015021 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.015178 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.015262 (+ 84us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.015341 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":59,"threads_started":1}
WARNING: no policy specified for oryx/127.15.157.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.157.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.157.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.188.keytab.
Entry for principal oryx/127.15.157.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.188.keytab.
I20260929 06:38:37.039305 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.188:38433
--webserver_interface=127.15.157.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.188.keytab
--principal=oryx/127.15.157.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:40403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:45285,127.15.157.189:45837,127.15.157.188:38433
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:37.119813 22741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:37.120040 22741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:37.120076 22741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:37.121205 22741 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:37.121275 22741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:37.121301 22741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:37.121335 22741 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:37.121356 22741 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:37.122864 22741 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:40403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:45285,127.15.157.189:45837,127.15.157.188:38433
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.188.keytab
--principal=oryx/127.15.157.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.188:38433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.157.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:37.123128 22741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:37.123342 22741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:37.128142 22746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:37.128245 22747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:37.128293 22741 server_base.cc:1034] running on GCE node
W20260929 06:38:37.128150 22749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:37.128744 22741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:37.129034 22741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:37.130160 22741 hybrid_clock.cc:648] HybridClock initialized: now 1790663917130142 us; error 40 us; skew 500 ppm
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:37.132481 22741 init.cc:377] Logged in from keytab as oryx/127.15.157.188@KRBTEST.COM (short username oryx)
I20260929 06:38:37.132911 22741 webserver.cc:460] Webserver started at http://127.15.157.188:43847/ using document root <none> and password file <none>
I20260929 06:38:37.133136 22741 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:37.133201 22741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:37.133334 22741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:37.134471 22741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/data/instance:
uuid: "094f8cde633246d68c7609971002819a"
format_stamp: "Formatted at 2026-09-29 06:38:37 on dist-test-slave-ltw5"
server_key: "1f6742876a72555b440c931266854b2f"
server_key_iv: "639b706aae2553e3711d49bfd0473102"
server_key_version: "encryptionkey@0"
I20260929 06:38:37.134826 22741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/wal/instance:
uuid: "094f8cde633246d68c7609971002819a"
format_stamp: "Formatted at 2026-09-29 06:38:37 on dist-test-slave-ltw5"
server_key: "1f6742876a72555b440c931266854b2f"
server_key_iv: "639b706aae2553e3711d49bfd0473102"
server_key_version: "encryptionkey@0"
I20260929 06:38:37.136080 22741 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:37.136724 22756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:37.136894 22741 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:37.136987 22741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/wal
uuid: "094f8cde633246d68c7609971002819a"
format_stamp: "Formatted at 2026-09-29 06:38:37 on dist-test-slave-ltw5"
server_key: "1f6742876a72555b440c931266854b2f"
server_key_iv: "639b706aae2553e3711d49bfd0473102"
server_key_version: "encryptionkey@0"
I20260929 06:38:37.137064 22741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:37.152736 22741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:37.154747 22741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:37.154901 22741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:37.158735 22741 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.188:38433
I20260929 06:38:37.158782 22808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.188:38433 every 8 connection(s)
I20260929 06:38:37.159137 22741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/data/info.pb
I20260929 06:38:37.160064 22809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:37.161538 22809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:37.164355 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 22741
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.188@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.157.188@KRBTEST.COM
I20260929 06:38:37.171551 22148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.162407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57158 (local address 127.15.157.190:45285)
0929 06:38:37.162460 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.162462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.162558 (+ 96us) server_negotiation.cc:407] Connection header received
0929 06:38:37.162980 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.162982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.162991 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.163046 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.163588 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.164118 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.165625 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.165875 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.165962 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.168494 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.168496 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.168496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.168503 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.170116 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.170508 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.170509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.170509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.170559 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.170839 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.170840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.170840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.170988 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.171042 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.171393 (+ 351us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.171488 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260929 06:38:37.171850 22811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.162275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.0.0.1:57158)
0929 06:38:37.162432 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.162471 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.162899 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.163104 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.163106 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.163337 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.163515 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.163519 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.164261 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.164262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.165469 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.165472 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.165985 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.165986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.166150 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.166662 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.166670 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.168413 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.170193 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.170199 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.170200 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.170425 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.170633 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.170634 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.170634 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.170760 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.171064 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.171071 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.171241 (+ 170us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.171351 (+ 110us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.171548 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
I20260929 06:38:37.172417 22809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:37.173629 22812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.164923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59388 (local address 127.15.157.188:38433)
0929 06:38:37.165073 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.165077 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.165093 (+ 16us) server_negotiation.cc:407] Connection header received
0929 06:38:37.165111 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.165113 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.165128 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.165192 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.165868 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.166725 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.167633 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.168137 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.168192 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.170451 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.170456 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.170456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.170462 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.172511 (+ 2049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.172910 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.172912 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.172912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.172961 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.173123 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.173124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.173125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.173294 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.173409 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.173504 (+ 95us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.173559 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":97,"threads_started":1}
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.188@KRBTEST.COM for oryx/127.15.157.189@KRBTEST.COM
I20260929 06:38:37.178799 22811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.172663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45837 (local address 127.0.0.1:33832)
0929 06:38:37.172698 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.172708 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.172740 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.173023 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.173024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.173171 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.173223 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.173224 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.174127 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.174128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.174696 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.174698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.175053 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.175054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.175110 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.175439 (+ 329us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.175442 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.176514 (+ 1072us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.178001 (+ 1487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.178002 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.178002 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.178199 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.178371 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.178372 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.178372 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.178417 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.178587 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.178587 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.178618 (+ 31us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.178666 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.178743 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260929 06:38:37.178798 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.172736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33832 (local address 127.15.157.189:45837)
0929 06:38:37.172787 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.172789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.172799 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:38:37.172825 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.172826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.172840 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.172897 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.173299 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.174053 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.174780 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.174972 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.175030 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.176591 (+ 1561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.176592 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.176592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.176599 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.177938 (+ 1339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.178271 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.178271 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.178272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.178316 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.178458 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.178458 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.178458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.178541 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.178584 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.178680 (+ 96us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.178740 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 06:38:37.179250 22809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.188@KRBTEST.COM for oryx/127.15.157.188@KRBTEST.COM
I20260929 06:38:37.185015 22811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.179485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:38433 (local address 127.0.0.1:59400)
0929 06:38:37.179531 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.179541 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.179585 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.179711 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.179712 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.179833 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.179855 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.179856 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.180444 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.180445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.180902 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.180903 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.181248 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.181249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.181296 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.181594 (+ 298us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.181598 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.182710 (+ 1112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.184182 (+ 1472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.184183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.184183 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.184326 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.184489 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.184489 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.184489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.184550 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.184803 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.184804 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.184835 (+ 31us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.184892 (+ 57us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.184958 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 06:38:37.185073 22812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.179535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59400 (local address 127.15.157.188:38433)
0929 06:38:37.179565 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.179566 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.179573 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:37.179639 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.179640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.179649 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.179708 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.179921 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.180361 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.180973 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.181166 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.181249 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.182778 (+ 1529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.182780 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.182780 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.182785 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.184120 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.184377 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.184378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.184379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.184435 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.184603 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.184604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.184604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.184744 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.184807 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.184908 (+ 101us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.185001 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":15}
I20260929 06:38:37.186436 22809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: Bootstrap starting.
I20260929 06:38:37.187232 22809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:37.187502 22809 log.cc:824] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:37.188191 22809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: No bootstrap required, opened a new log
I20260929 06:38:37.189978 22809 raft_consensus.cc:348] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } }
I20260929 06:38:37.190176 22809 raft_consensus.cc:374] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:37.190224 22809 raft_consensus.cc:729] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 094f8cde633246d68c7609971002819a, State: Initialized, Role: FOLLOWER
I20260929 06:38:37.190371 22809 consensus_queue.cc:260] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } }
I20260929 06:38:37.190665 22809 sys_catalog.cc:564] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:37.190645 22814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } } }
I20260929 06:38:37.190752 22814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [sys.catalog]: This master's current role is: FOLLOWER
W20260929 06:38:37.192452 22825 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:38:37.192503 22825 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:38:37.195389 22741 master_runner.cc:428] Detected that this master 094f8cde633246d68c7609971002819a is joining an existing cluster
I20260929 06:38:37.195451 22741 master_runner.cc:432] Initiating AddMaster RPC to add 127.15.157.188:38433
I20260929 06:38:37.203578 22833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.196538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:38433 (local address 127.0.0.1:59416)
0929 06:38:37.196993 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.197005 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.197072 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.197245 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.197246 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.197631 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.197690 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.197692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.198624 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.198625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.199516 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.199517 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.199992 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.199993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.200049 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.200554 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.200559 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.200900 (+ 341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.202602 (+ 1702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.202603 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.202604 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.202791 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.202989 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.202990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.202990 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.203075 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.203320 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.203321 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.203368 (+ 47us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.203421 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.203502 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":82,"threads_started":1}
I20260929 06:38:37.203676 22812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.196726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59416 (local address 127.15.157.188:38433)
0929 06:38:37.196785 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.196786 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.197070 (+ 284us) server_negotiation.cc:407] Connection header received
0929 06:38:37.197147 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.197148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.197157 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.197187 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.197772 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.198537 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.199605 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.199869 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.199906 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.200996 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.200998 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.200998 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.201004 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.202505 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.202862 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.202863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.202864 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.202924 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.203117 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.203117 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.203118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.203255 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.203327 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.203464 (+ 137us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.203564 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":37}
I20260929 06:38:37.225093 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 22151
I20260929 06:38:37.230696 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.196609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33846 (local address 127.15.157.189:45837)
0929 06:38:37.196653 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.196655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.197091 (+ 436us) server_negotiation.cc:407] Connection header received
0929 06:38:37.197118 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.197119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.197130 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.197202 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.197746 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.198547 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.199694 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.199991 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.200032 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.227788 (+ 27756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.227790 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.227790 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.227799 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.229473 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.229857 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.229858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.229859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.229911 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.230126 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.230127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.230127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.230273 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.230316 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.230513 (+ 197us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.230593 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:38:37.230882 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:39687
--local_ip_for_outbound_sockets=127.15.157.129
--tserver_master_addrs=127.15.157.190:45285
--webserver_port=41057
--webserver_interface=127.15.157.129
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.129.keytab
--principal=oryx/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:40403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.157.190:45285,127.15.157.189:45837
--tserver_master_addrs=127.15.157.190:45285,127.15.157.189:45837,127.15.157.188:38433 with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:38:37.231686 22831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.196540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45837 (local address 127.0.0.1:33846)
0929 06:38:37.196994 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.197005 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.197067 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.197254 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.197255 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.197563 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.197648 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.197651 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.198643 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.198644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.199593 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.199596 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.200108 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.200109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.200171 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.227186 (+ 27015us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.227203 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.227657 (+ 454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.229570 (+ 1913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.229571 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.229572 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.229775 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.229979 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.229980 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.229980 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.230056 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.230361 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.230362 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.230408 (+ 46us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.231449 (+ 1041us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.231571 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"mutex_wait_us":42,"spinlock_wait_cycles":896,"thread_start_us":90,"threads_started":1}
I20260929 06:38:37.231833 22148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.196859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57166 (local address 127.15.157.190:45285)
0929 06:38:37.196929 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.196931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.197204 (+ 273us) server_negotiation.cc:407] Connection header received
0929 06:38:37.197299 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.197300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.197310 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.197340 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.197825 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.198565 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.199612 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.199920 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.199960 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.228524 (+ 28564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.228526 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.228526 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.228534 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.230549 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.230968 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.230969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.230969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.231028 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.231214 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.231215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.231215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.231349 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.231390 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.231595 (+ 205us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.231682 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 06:38:37.232169 22832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.196870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.0.0.1:57166)
0929 06:38:37.197154 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.197163 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.197226 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.197401 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.197402 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.197682 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.197730 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.197732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.198651 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.198652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.199525 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.199527 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.200027 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.200027 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.200078 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.227664 (+ 27586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.227669 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.228411 (+ 742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.230643 (+ 2232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.230644 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.230645 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.230873 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.231097 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.231097 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.231098 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.231152 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.231434 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.231435 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.231488 (+ 53us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.231909 (+ 421us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.232024 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":37,"thread_start_us":76,"threads_started":1}
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663916, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.190@KRBTEST.COM for oryx/127.15.157.188@KRBTEST.COM
I20260929 06:38:37.242218 22812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.234383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59432 (local address 127.15.157.188:38433)
0929 06:38:37.234422 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.234425 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.234435 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:38:37.234471 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.234472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.234481 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.234534 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.234876 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.235619 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.236630 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.236918 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.236974 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.239232 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.239234 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.239234 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.239241 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.240841 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.241262 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.241263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.241263 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.241320 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.241539 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.241540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.241540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.241668 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.241734 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.241916 (+ 182us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.241988 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:37.242288 22647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.234324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:38433 (local address 127.0.0.1:59432)
0929 06:38:37.234361 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.234372 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.234413 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.234556 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.234558 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.234734 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.234794 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.234796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.235712 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.235713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.236538 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.236541 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.237021 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.237022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.237093 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.237516 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.237521 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.239143 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.240923 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.240924 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.240925 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.241181 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.241398 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.241398 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.241399 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.241468 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.241741 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.241742 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.241801 (+ 59us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.241882 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.241996 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260929 06:38:37.243151 22089 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.15.157.188:38433: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "094f8cde633246d68c7609971002819a"
member_type: NON_VOTER
last_known_addr {
host: "127.15.157.188"
port: 38433
}
attrs {
promote: true
}
}
dest_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091"
cas_config_opid_index: 5
I20260929 06:38:37.243389 22089 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: NON_VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: true } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } }
I20260929 06:38:37.243691 22648 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 094f8cde633246d68c7609971002819a (127.15.157.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: NON_VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: true } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } } }
I20260929 06:38:37.244627 22648 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.15.157.188:38433
I20260929 06:38:37.244702 22648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: NON_VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: true } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } } }
I20260929 06:38:37.244777 22648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:37.245151 22741 master.cc:537] Master@127.15.157.188:38433 shutting down...
W20260929 06:38:37.245851 22075 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 -> Peer 094f8cde633246d68c7609971002819a (127.15.157.188:38433): Couldn't send request to peer 094f8cde633246d68c7609971002819a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260929 06:38:37.248890 22741 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:37.248986 22741 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:37.249028 22741 tablet_replica.cc:330] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: stopping tablet replica
I20260929 06:38:37.250916 22647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.244963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45837 (local address 127.0.0.1:33862)
0929 06:38:37.245699 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.245710 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.245764 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.245973 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.245974 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.245975 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:37.246010 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.246011 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.246885 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.246886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.248908 (+ 2022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.248911 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.250602 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.250604 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.250674 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.250701 (+ 27us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.250769 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.250819 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721}
I20260929 06:38:37.251192 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.245031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33862 (local address 127.15.157.189:45837)
0929 06:38:37.245071 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.245073 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.245817 (+ 744us) server_negotiation.cc:407] Connection header received
0929 06:38:37.245844 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.245845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.245869 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.245923 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:37.246110 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.246796 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.249009 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.250454 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.250513 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.250570 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.251066 (+ 496us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.251115 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:38:37.251426 22697 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 LEARNER]: Refusing update from remote peer 4540dd34fb5d4c96b0e4a7ebea42d091: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260929 06:38:37.251595 22649 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: NON_VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260929 06:38:37.252122 22697 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 094f8cde633246d68c7609971002819a (127.15.157.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: NON_VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: true } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } } }
I20260929 06:38:37.252713 22741 master.cc:552] Master@127.15.157.188:38433 shutdown complete.
I20260929 06:38:37.252789 22741 master_runner.cc:305] Clearing existing system tablet
I20260929 06:38:37.252954 22741 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:37.253026 22741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:37.253171 22726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4540dd34fb5d4c96b0e4a7ebea42d091. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: NON_VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: true } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } } }
I20260929 06:38:37.253254 22726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: This master's current role is: LEARNER
I20260929 06:38:37.253289 22726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: NON_VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: true } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } } }
I20260929 06:38:37.253333 22726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: This master's current role is: LEARNER
I20260929 06:38:37.253937 22741 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:37.254400 22649 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091: attempting to promote NON_VOTER 2fe578c668a549c58263b9d014a0b76f to VOTER
I20260929 06:38:37.254597 22649 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } }
I20260929 06:38:37.255245 22647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.255093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:38433 (local address 127.0.0.1:59438)
0929 06:38:37.255176 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.255218 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:38433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260929 06:38:37.255270 22697 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 LEARNER]: Refusing update from remote peer 4540dd34fb5d4c96b0e4a7ebea42d091: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260929 06:38:37.255532 22838 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260929 06:38:37.255604 22647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.255477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:38433 (local address 127.0.0.1:59452)
0929 06:38:37.255510 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.255536 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:38433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260929 06:38:37.255746 22075 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 -> Peer 094f8cde633246d68c7609971002819a (127.15.157.188:38433): Couldn't send request to peer 094f8cde633246d68c7609971002819a. Status: Network error: Client connection negotiation failed: client connection to 127.15.157.188:38433: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 06:38:37.256263 22648 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 2fe578c668a549c58263b9d014a0b76f (127.15.157.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } } }
I20260929 06:38:37.256457 22697 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 2fe578c668a549c58263b9d014a0b76f (127.15.157.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } } }
I20260929 06:38:37.257184 22648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } } }
I20260929 06:38:37.257251 22648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:37.257296 22648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } } }
I20260929 06:38:37.257336 22648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:37.257507 22836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } } }
I20260929 06:38:37.257596 22836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:37.265681 22839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:37.265843 22741 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:37.265931 22741 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.000s sys 0.000s
I20260929 06:38:37.265957 22741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/wal
uuid: "094f8cde633246d68c7609971002819a"
format_stamp: "Formatted at 2026-09-29 06:38:37 on dist-test-slave-ltw5"
server_key: "1f6742876a72555b440c931266854b2f"
server_key_iv: "639b706aae2553e3711d49bfd0473102"
server_key_version: "encryptionkey@0"
I20260929 06:38:37.266794 22741 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:37.268262 22741 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260929 06:38:37.268333 22741 log.cc:1196] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260929 06:38:37.268554 22741 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: Deleting consensus metadata
I20260929 06:38:37.268685 22741 master_runner.cc:315] Copying system tablet from 127.15.157.190:45285
I20260929 06:38:37.269302 22741 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: tablet copy: Beginning tablet copy session from remote peer at address 127.15.157.190:45285
I20260929 06:38:37.276681 22148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.269737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57180 (local address 127.15.157.190:45285)
0929 06:38:37.269788 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.269790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.269891 (+ 101us) server_negotiation.cc:407] Connection header received
0929 06:38:37.269946 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.269947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.269958 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.270127 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.270518 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.271277 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.272287 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.272581 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.272653 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.273742 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.273743 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.273744 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.273751 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.275388 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.275797 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.275798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.275799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.275858 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.276138 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.276139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.276139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.276274 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.276343 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.276512 (+ 169us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.276587 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 06:38:37.276687 22846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.269684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.0.0.1:57180)
0929 06:38:37.269809 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.269820 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.269888 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.270161 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.270162 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.270372 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.270428 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.270430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.271372 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.271373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.272185 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.272188 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.272670 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.272671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.272734 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.273257 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.273262 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.273651 (+ 389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.275479 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.275480 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.275480 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.275719 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.275934 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.275934 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.275935 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.276002 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.276350 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.276351 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.276401 (+ 50us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.276479 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.276586 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
I20260929 06:38:37.277367 22109 tablet_copy_service.cc:140] P 4540dd34fb5d4c96b0e4a7ebea42d091: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 094f8cde633246d68c7609971002819a ({username='oryx', principal='oryx/127.15.157.188@KRBTEST.COM'} at 127.0.0.1:57180)
I20260929 06:38:37.277431 22109 tablet_copy_service.cc:161] P 4540dd34fb5d4c96b0e4a7ebea42d091: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 094f8cde633246d68c7609971002819a at {username='oryx', principal='oryx/127.15.157.188@KRBTEST.COM'} at 127.0.0.1:57180: session id = 094f8cde633246d68c7609971002819a-00000000000000000000000000000000
I20260929 06:38:37.277988 22109 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 06:38:37.278445 22741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260929 06:38:37.279714 22741 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: tablet copy: Starting download of 0 data blocks...
I20260929 06:38:37.279871 22741 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: tablet copy: Starting download of 1 WAL segments...
I20260929 06:38:37.280670 22741 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 06:38:37.281729 22109 tablet_copy_service.cc:342] P 4540dd34fb5d4c96b0e4a7ebea42d091: Request end of tablet copy session 094f8cde633246d68c7609971002819a-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.15.157.188@KRBTEST.COM'} at 127.0.0.1:57180
I20260929 06:38:37.281790 22109 tablet_copy_service.cc:433] P 4540dd34fb5d4c96b0e4a7ebea42d091: ending tablet copy session 094f8cde633246d68c7609971002819a-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 094f8cde633246d68c7609971002819a
I20260929 06:38:37.285676 22741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:37.287009 22847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:37.287163 22850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:37.287398 22741 server_base.cc:1034] running on GCE node
W20260929 06:38:37.290159 22848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:37.290347 22741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:37.290508 22741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:37.291658 22741 hybrid_clock.cc:648] HybridClock initialized: now 1790663917291649 us; error 35 us; skew 500 ppm
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:37.293195 22741 init.cc:377] Logged in from keytab as oryx/127.15.157.188@KRBTEST.COM (short username oryx)
I20260929 06:38:37.293442 22741 webserver.cc:460] Webserver started at http://127.15.157.188:42775/ using document root <none> and password file <none>
I20260929 06:38:37.293558 22741 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:37.293594 22741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:37.294328 22741 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:37.294858 22857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:37.294961 22741 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:37.294992 22741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/wal
uuid: "094f8cde633246d68c7609971002819a"
format_stamp: "Formatted at 2026-09-29 06:38:37 on dist-test-slave-ltw5"
server_key: "1f6742876a72555b440c931266854b2f"
server_key_iv: "639b706aae2553e3711d49bfd0473102"
server_key_version: "encryptionkey@0"
I20260929 06:38:37.295049 22741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:37.326597 22741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:37.328559 22741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:37.331900 22741 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.188:38433
I20260929 06:38:37.331938 22909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.188:38433 every 8 connection(s)
I20260929 06:38:37.332284 22741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/master-2/data/info.pb
I20260929 06:38:37.333230 22910 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:38:37.333745 22910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: Bootstrap starting.
I20260929 06:38:37.336829 22910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:38:37.337045 22910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: Bootstrap complete.
I20260929 06:38:37.337229 22910 raft_consensus.cc:348] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } }
I20260929 06:38:37.337314 22910 raft_consensus.cc:729] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 094f8cde633246d68c7609971002819a, State: Initialized, Role: LEARNER
I20260929 06:38:37.337348 22910 consensus_queue.cc:260] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } }
I20260929 06:38:37.337522 22910 sys_catalog.cc:564] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:37.337525 22913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } } }
I20260929 06:38:37.337764 22913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [sys.catalog]: This master's current role is: LEARNER
I20260929 06:38:37.338897 22924 catalog_manager.cc:1259] Loaded cluster ID: c8ae0126f5d44dd094c05a68c82a1f71
I20260929 06:38:37.338980 22924 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: loading cluster ID for follower catalog manager: success
I20260929 06:38:37.340351 22924 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: acquiring CA information for follower catalog manager: success
I20260929 06:38:37.340629 22924 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260929 06:38:37.342842 22834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:37.343130 22834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:37.343178 22834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:37.344347 22834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:37.344408 22834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:37.344452 22834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:37.345952 22834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:40403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.129.keytab
--principal=oryx/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:39687
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=41057
--tserver_master_addrs=127.15.157.190:45285,127.15.157.189:45837,127.15.157.188:38433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:37.346235 22834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:37.346472 22834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:37.351461 22929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:37.351603 22834 server_base.cc:1034] running on GCE node
W20260929 06:38:37.351456 22932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:37.351455 22930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:37.351864 22834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:37.352098 22834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:37.353256 22834 hybrid_clock.cc:648] HybridClock initialized: now 1790663917353252 us; error 52 us; skew 500 ppm
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:37.355742 22834 init.cc:377] Logged in from keytab as oryx/127.15.157.129@KRBTEST.COM (short username oryx)
I20260929 06:38:37.356178 22834 webserver.cc:460] Webserver started at http://127.15.157.129:41057/ using document root <none> and password file <none>
I20260929 06:38:37.356353 22834 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:37.356403 22834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:37.357631 22834 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:37.358237 22939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:37.358397 22834 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:38:37.358465 22834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "c6474efaac22405e840b064c9f85f2bd"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "dffd5423e3e6ad1f6c94bd63d1ee68de"
server_key_iv: "c4965a2d6b3a4686fec522ab19fd71c9"
server_key_version: "encryptionkey@0"
I20260929 06:38:37.358774 22834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:37.369473 22834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:37.371290 22834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:37.371395 22834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:37.371562 22834 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:37.371804 22834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:37.371833 22834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:37.371855 22834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:37.371867 22834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:37.378377 22834 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:39687
I20260929 06:38:37.378441 23052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:39687 every 8 connection(s)
I20260929 06:38:37.378788 22834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.189@KRBTEST.COM
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.188@KRBTEST.COM
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
I20260929 06:38:37.388016 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 22834
I20260929 06:38:37.388164 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 22285
I20260929 06:38:37.389530 22148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.379482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:58897 (local address 127.15.157.190:45285)
0929 06:38:37.379599 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.379601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.379954 (+ 353us) server_negotiation.cc:407] Connection header received
0929 06:38:37.380481 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.380482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.380496 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.380554 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.381306 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.381816 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.382956 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.383243 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.383304 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.386482 (+ 3178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.386483 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.386483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.386490 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.388272 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.388650 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.388651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.388651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.388704 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.388914 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.388915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.388916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.389050 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.389091 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.389347 (+ 256us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.389426 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260929 06:38:37.389745 23058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.379469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:38433 (local address 127.15.157.129:44897)
0929 06:38:37.379810 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.379835 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.380362 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.381015 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.381015 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.381156 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.381206 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.381212 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.382442 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.382443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.383216 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.383217 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.383655 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.383656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.383723 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.384373 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.384378 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.385901 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.388046 (+ 2145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.388053 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.388055 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.388375 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.388575 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.388575 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.388576 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.388702 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.388993 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.388999 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.389162 (+ 163us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.389280 (+ 118us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.389463 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"mutex_wait_us":189,"thread_start_us":84,"threads_started":1}
I20260929 06:38:37.389868 23057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.379470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.129:58897)
0929 06:38:37.379794 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.379834 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.380379 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.380630 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.380633 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.380989 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.381205 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.381209 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.381919 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.381919 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.382874 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.382876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.383363 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.383364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.383496 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.384236 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.384240 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.386398 (+ 2158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.388370 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.388371 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.388372 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.388576 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.388778 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.388779 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.388779 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.388840 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.389138 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.389139 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.389182 (+ 43us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.389661 (+ 479us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.389757 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":1,"thread_start_us":84,"threads_started":1}
I20260929 06:38:37.390132 23059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.379565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:44897 (local address 127.15.157.188:38433)
0929 06:38:37.379672 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.379674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.379974 (+ 300us) server_negotiation.cc:407] Connection header received
0929 06:38:37.380487 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.380488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.380502 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.380547 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.381312 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.382358 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.383291 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.383575 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.383642 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.385995 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.385997 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.385997 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.386004 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.387947 (+ 1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.388455 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.388456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.388457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.388513 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.388772 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.388773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.388774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.388912 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.388969 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.389873 (+ 904us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.389966 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":47,"threads_started":1}
I20260929 06:38:37.390331 23054 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45285
I20260929 06:38:37.390429 23054 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:37.390631 23054 heartbeater.cc:511] Master 127.15.157.190:45285 requested a full tablet report, sending...
I20260929 06:38:37.390686 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.379536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:47789 (local address 127.15.157.189:45837)
0929 06:38:37.379637 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.379639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.379931 (+ 292us) server_negotiation.cc:407] Connection header received
0929 06:38:37.380486 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.380487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.380500 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.380542 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.381312 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.382086 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.383122 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.383406 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.383472 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.386394 (+ 2922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.386396 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.386396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.386403 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.388406 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.389082 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.389083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.389083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.389136 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.389336 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.389336 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.389337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.389470 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.389512 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.390518 (+ 1006us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.390594 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260929 06:38:37.391000 23060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.379469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45837 (local address 127.15.157.129:47789)
0929 06:38:37.379795 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.379835 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.380362 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.380627 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.380632 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.380993 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.381206 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.381212 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.382174 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.382174 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.383025 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.383027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.383477 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.383478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.383557 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.384077 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.384087 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.386313 (+ 2226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.388815 (+ 2502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.388816 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.388816 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.389002 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.389207 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.389208 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.389208 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.389263 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.389559 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.389560 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.390388 (+ 828us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.390796 (+ 408us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.390892 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":22,"thread_start_us":85,"threads_started":1}
I20260929 06:38:37.391031 22089 ts_manager.cc:194] Re-registered known tserver with Master: c6474efaac22405e840b064c9f85f2bd (127.15.157.129:39687)
I20260929 06:38:37.391374 22089 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:58897
I20260929 06:38:37.393837 23055 heartbeater.cc:347] Connected to a master server at 127.15.157.189:45837
I20260929 06:38:37.393864 23053 heartbeater.cc:347] Connected to a master server at 127.15.157.188:38433
I20260929 06:38:37.393895 23055 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:37.393918 23053 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:37.393970 23055 heartbeater.cc:511] Master 127.15.157.189:45837 requested a full tablet report, sending...
I20260929 06:38:37.393976 23053 heartbeater.cc:511] Master 127.15.157.188:38433 requested a full tablet report, sending...
I20260929 06:38:37.394407 22874 ts_manager.cc:194] Registered new tserver with Master: c6474efaac22405e840b064c9f85f2bd (127.15.157.129:39687)
I20260929 06:38:37.394399 22687 ts_manager.cc:194] Registered new tserver with Master: c6474efaac22405e840b064c9f85f2bd (127.15.157.129:39687)
I20260929 06:38:37.395321 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:42155
--local_ip_for_outbound_sockets=127.15.157.130
--tserver_master_addrs=127.15.157.190:45285
--webserver_port=39295
--webserver_interface=127.15.157.130
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.130.keytab
--principal=oryx/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:40403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.157.190:45285,127.15.157.189:45837
--tserver_master_addrs=127.15.157.190:45285,127.15.157.189:45837,127.15.157.188:38433 with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:37.476475 23061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:37.476672 23061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:37.476701 23061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:37.477844 23061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:37.477888 23061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:37.477914 23061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:37.479374 23061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:40403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.130.keytab
--principal=oryx/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:42155
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=39295
--tserver_master_addrs=127.15.157.190:45285,127.15.157.189:45837,127.15.157.188:38433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:37.479614 23061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:37.479856 23061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:37.484926 23066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:37.484941 23061 server_base.cc:1034] running on GCE node
W20260929 06:38:37.485037 23069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:37.484932 23067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:37.485296 23061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:37.485491 23061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:37.486656 23061 hybrid_clock.cc:648] HybridClock initialized: now 1790663917486641 us; error 28 us; skew 500 ppm
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:37.489066 23061 init.cc:377] Logged in from keytab as oryx/127.15.157.130@KRBTEST.COM (short username oryx)
I20260929 06:38:37.489499 23061 webserver.cc:460] Webserver started at http://127.15.157.130:39295/ using document root <none> and password file <none>
I20260929 06:38:37.489755 23061 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:37.489837 23061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:37.491233 23061 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:37.491842 23076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:37.492030 23061 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:37.492125 23061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "be05363333594e1ea376d3017d0a3c0e"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "d419cfce8724db85d31dcf48857fbcb5"
server_key_iv: "69ab951f0eb4fdb322790e4a1aeedeff"
server_key_version: "encryptionkey@0"
I20260929 06:38:37.492491 23061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:37.524039 23061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:37.525904 23061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:37.526094 23061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:37.526335 23061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:37.526641 23061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:37.526695 23061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:37.526739 23061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:37.526777 23061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:37.532510 23061 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:42155
I20260929 06:38:37.532554 23189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:42155 every 8 connection(s)
I20260929 06:38:37.532903 23061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.189@KRBTEST.COM
I20260929 06:38:37.540088 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 23061
I20260929 06:38:37.540239 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 22419
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.188@KRBTEST.COM
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
I20260929 06:38:37.544376 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.533609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:34523 (local address 127.15.157.189:45837)
0929 06:38:37.533654 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.533656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.533991 (+ 335us) server_negotiation.cc:407] Connection header received
0929 06:38:37.535043 (+ 1052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.535044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.535055 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.535118 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.535851 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.536344 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.537480 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.537723 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.537796 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.540696 (+ 2900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.540698 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.540698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.540706 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.542489 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.542967 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.542968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.542969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.543028 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.543342 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.543343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.543344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.543636 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.543681 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.544154 (+ 473us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.544251 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:37.544931 23194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.533608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45837 (local address 127.15.157.130:34523)
0929 06:38:37.533858 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.533920 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.534939 (+ 1019us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.535190 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.535194 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.535559 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.535759 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.535764 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.536446 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.536446 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.537249 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.537372 (+ 123us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.537826 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.537827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.537988 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.538606 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.538616 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.540247 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.542570 (+ 2323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.542576 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.542578 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.542874 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.543107 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.543108 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.543108 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.543248 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.543732 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.543738 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.543980 (+ 242us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.544486 (+ 506us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.544666 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":94,"threads_started":1}
I20260929 06:38:37.545681 22148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.533995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:36505 (local address 127.15.157.190:45285)
0929 06:38:37.534071 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.534072 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.534194 (+ 122us) server_negotiation.cc:407] Connection header received
0929 06:38:37.535057 (+ 863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.535058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.535069 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.535102 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.535865 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.536617 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.537689 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.538099 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.538163 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.541966 (+ 3803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.541967 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.541967 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.541975 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.543916 (+ 1941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.544326 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.544328 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.544328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.544383 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.544847 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.544848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.544848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.545213 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.545260 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.545480 (+ 220us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.545563 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260929 06:38:37.545703 23196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.533883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.130:36505)
0929 06:38:37.534133 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.534140 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.534960 (+ 820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.535191 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.535194 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.535633 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.535760 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.535766 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.536718 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.536718 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.537610 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.537612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.538223 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.538224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.538284 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.538938 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.538942 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.541875 (+ 2933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.544002 (+ 2127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.544003 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.544003 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.544245 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.544682 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.544683 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.544683 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.544775 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.545307 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.545308 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.545352 (+ 44us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.545437 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.545545 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":35,"thread_start_us":66,"threads_started":1}
I20260929 06:38:37.546193 23059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.533681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:49299 (local address 127.15.157.188:38433)
0929 06:38:37.533737 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.533739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.534094 (+ 355us) server_negotiation.cc:407] Connection header received
0929 06:38:37.535056 (+ 962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.535057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.535073 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.535103 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.535867 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.536622 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.537733 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.538049 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.538120 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.543398 (+ 5278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.543399 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.543400 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.543408 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.545062 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.545393 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.545394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.545394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.545447 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.545646 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.545646 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.545647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.545772 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.545816 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.546009 (+ 193us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.546107 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 06:38:37.547029 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:46633
--local_ip_for_outbound_sockets=127.15.157.131
--tserver_master_addrs=127.15.157.190:45285
--webserver_port=42005
--webserver_interface=127.15.157.131
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.131.keytab
--principal=oryx/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:40403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.157.190:45285,127.15.157.189:45837
--tserver_master_addrs=127.15.157.190:45285,127.15.157.189:45837,127.15.157.188:38433 with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:38:37.546212 23195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.533609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:38433 (local address 127.15.157.130:49299)
0929 06:38:37.534015 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.534026 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.534956 (+ 930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.535201 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.535201 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.535629 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.535760 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.535766 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.536713 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.536713 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.537674 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.537676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.538119 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.538120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.538191 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.538747 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.538751 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.543303 (+ 4552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.545153 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.545154 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.545155 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.545317 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.545520 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.545521 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.545521 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.545575 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.545860 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.545861 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.545902 (+ 41us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.545974 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.546097 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":45,"thread_start_us":85,"threads_started":1}
I20260929 06:38:37.548112 23190 heartbeater.cc:347] Connected to a master server at 127.15.157.188:38433
I20260929 06:38:37.548204 23191 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45285
I20260929 06:38:37.548221 23190 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:37.548270 23191 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:37.548460 23190 heartbeater.cc:511] Master 127.15.157.188:38433 requested a full tablet report, sending...
I20260929 06:38:37.548461 23191 heartbeater.cc:511] Master 127.15.157.190:45285 requested a full tablet report, sending...
I20260929 06:38:37.548475 23192 heartbeater.cc:347] Connected to a master server at 127.15.157.189:45837
I20260929 06:38:37.548558 23192 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:37.548604 23192 heartbeater.cc:511] Master 127.15.157.189:45837 requested a full tablet report, sending...
I20260929 06:38:37.548851 22089 ts_manager.cc:194] Re-registered known tserver with Master: be05363333594e1ea376d3017d0a3c0e (127.15.157.130:42155)
I20260929 06:38:37.548872 22874 ts_manager.cc:194] Registered new tserver with Master: be05363333594e1ea376d3017d0a3c0e (127.15.157.130:42155)
I20260929 06:38:37.548872 22687 ts_manager.cc:194] Registered new tserver with Master: be05363333594e1ea376d3017d0a3c0e (127.15.157.130:42155)
I20260929 06:38:37.549340 22089 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:36505
W20260929 06:38:37.629458 23197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:37.629712 23197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:37.629748 23197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:37.630990 23197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:37.631052 23197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:37.631098 23197 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:37.632678 23197 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:40403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.131.keytab
--principal=oryx/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:46633
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=42005
--tserver_master_addrs=127.15.157.190:45285,127.15.157.189:45837,127.15.157.188:38433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:37.632951 23197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:37.633176 23197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:37.638171 23203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:37.638226 23202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:37.638378 23197 server_base.cc:1034] running on GCE node
W20260929 06:38:37.638185 23205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:37.638700 23197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:37.638942 23197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:37.640111 23197 hybrid_clock.cc:648] HybridClock initialized: now 1790663917640095 us; error 27 us; skew 500 ppm
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:37.642637 23197 init.cc:377] Logged in from keytab as oryx/127.15.157.131@KRBTEST.COM (short username oryx)
I20260929 06:38:37.643092 23197 webserver.cc:460] Webserver started at http://127.15.157.131:42005/ using document root <none> and password file <none>
I20260929 06:38:37.643314 23197 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:37.643395 23197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:37.644824 23197 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:37.645361 23212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:37.645522 23197 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:37.645617 23197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "7be196a581b047d29464880bf68c01d0"
format_stamp: "Formatted at 2026-09-29 06:38:36 on dist-test-slave-ltw5"
server_key: "57740160a93f67d97d8ff6ca694f2f21"
server_key_iv: "778f515a35ca036fbf20a62cb033920a"
server_key_version: "encryptionkey@0"
I20260929 06:38:37.645954 23197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:37.670686 23197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:37.672565 23197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:37.672720 23197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:37.672972 23197 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:37.673283 23197 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:37.673334 23197 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:37.673375 23197 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:37.673416 23197 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:37.679548 23197 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:46633
I20260929 06:38:37.679595 23325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:46633 every 8 connection(s)
I20260929 06:38:37.679932 23197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:38:37.682411 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 23197
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.188@KRBTEST.COM
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
Sep 29 06:38:37 dist-test-slave-ltw5 krb5kdc[22044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663917, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.189@KRBTEST.COM
I20260929 06:38:37.693542 23332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.680655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.131:36571)
0929 06:38:37.681134 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.681144 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.682147 (+ 1003us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.682922 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.682922 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.683065 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.683227 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.683233 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.686211 (+ 2978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.686212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.686975 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.686977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.687566 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.687567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.687640 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.688049 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.688055 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.689768 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.691836 (+ 2068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.691844 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.691846 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.692147 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.692386 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.692388 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.692388 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.692521 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.692825 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.692832 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.692999 (+ 167us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.693107 (+ 108us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.693277 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"mutex_wait_us":3,"thread_start_us":97,"threads_started":1}
I20260929 06:38:37.694010 22148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.680668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:36571 (local address 127.15.157.190:45285)
0929 06:38:37.680723 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.680725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.681219 (+ 494us) server_negotiation.cc:407] Connection header received
0929 06:38:37.682797 (+ 1578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.682799 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.682813 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.682867 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.685424 (+ 2557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.686136 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.687040 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.687226 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.687311 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.689858 (+ 2547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.689859 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.689860 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.689866 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.691762 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.692257 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.692258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.692259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.692314 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.692592 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.692593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.692593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.692735 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.692798 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.693804 (+ 1006us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.693902 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 06:38:37.694345 23327 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45285
I20260929 06:38:37.694455 23327 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:37.694643 23331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.680977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:38433 (local address 127.15.157.131:53409)
0929 06:38:37.681180 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.681191 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.682152 (+ 961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.682394 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.682398 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.682913 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.683227 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.683233 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.685397 (+ 2164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.685397 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.686297 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.686299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.687053 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.687054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.687120 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.687575 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.687579 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.690346 (+ 2767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.693060 (+ 2714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.693061 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.693061 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.693281 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.693470 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.693470 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.693471 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.693533 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.694278 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.694279 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.694336 (+ 57us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.694396 (+ 60us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.694502 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":24,"thread_start_us":86,"threads_started":1}
I20260929 06:38:37.694653 23327 heartbeater.cc:511] Master 127.15.157.190:45285 requested a full tablet report, sending...
I20260929 06:38:37.695214 22089 ts_manager.cc:194] Re-registered known tserver with Master: 7be196a581b047d29464880bf68c01d0 (127.15.157.131:46633)
I20260929 06:38:37.695731 23059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.681089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:53409 (local address 127.15.157.188:38433)
0929 06:38:37.681134 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.681135 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.681245 (+ 110us) server_negotiation.cc:407] Connection header received
0929 06:38:37.682250 (+ 1005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.682252 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.682264 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.682311 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.684229 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.685325 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.686380 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.686666 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.687274 (+ 608us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.690781 (+ 3507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.690783 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.690783 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.690790 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.692935 (+ 2145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.693356 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.693358 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.693358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.693410 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.693625 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.693627 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.693627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.693769 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.693839 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.695525 (+ 1686us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.695622 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:38:37.695729 22089 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:36571
I20260929 06:38:37.696376 23326 heartbeater.cc:347] Connected to a master server at 127.15.157.188:38433
I20260929 06:38:37.696431 23326 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:37.696507 23326 heartbeater.cc:511] Master 127.15.157.188:38433 requested a full tablet report, sending...
I20260929 06:38:37.696763 23341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.684034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43272 (local address 127.15.157.190:45285)
0929 06:38:37.684546 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.684548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.684555 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:37.684575 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.684575 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.684585 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.684646 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.686725 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.687479 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.688708 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.689088 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.689152 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.691159 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.691160 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.691161 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.691168 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.695096 (+ 3928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.695573 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.695574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.695574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.695627 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.696042 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.696042 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.696043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.696160 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.696265 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.696524 (+ 259us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.696654 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":81,"threads_started":1}
I20260929 06:38:37.696786 22874 ts_manager.cc:194] Registered new tserver with Master: 7be196a581b047d29464880bf68c01d0 (127.15.157.131:46633)
I20260929 06:38:37.697266 23338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.683650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59584 (local address 127.15.157.189:45837)
0929 06:38:37.684400 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.684402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.684409 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:37.684428 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.684428 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.684438 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.685878 (+ 1440us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.685910 (+ 32us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.686645 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.689653 (+ 3008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.690626 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.693183 (+ 2557us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.693222 (+ 39us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.693223 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.693223 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.693227 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.695762 (+ 2535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.696202 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.696202 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.696203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.696271 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.696524 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.696525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.696525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.696659 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.697018 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.697060 (+ 42us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.697136 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":730,"thread_start_us":60,"threads_started":1}
I20260929 06:38:37.698343 23330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.680655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45837 (local address 127.15.157.131:52991)
0929 06:38:37.680820 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.680855 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.682146 (+ 1291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.682400 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.682402 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.682901 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:37.683226 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.683232 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.684206 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.684207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.685871 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.685873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.686411 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.686412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.686544 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.687421 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:37.687431 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:37.693070 (+ 5639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:37.697000 (+ 3930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.697001 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.697001 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.697202 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.697441 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:37.697442 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:37.697442 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:37.697498 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:37.697780 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:37.697780 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:37.697817 (+ 37us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.697883 (+ 66us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.697988 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":29,"thread_start_us":96,"threads_started":1}
I20260929 06:38:37.698514 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.680712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:52991 (local address 127.15.157.189:45837)
0929 06:38:37.680904 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.680906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.680918 (+ 12us) server_negotiation.cc:407] Connection header received
0929 06:38:37.682280 (+ 1362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.682282 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.682295 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.682328 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.683334 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.684108 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.685965 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.686292 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.686331 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.693173 (+ 6842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.693175 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.693175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.693182 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.696295 (+ 3113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.697284 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.697285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.697285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.697336 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.697565 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.697566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.697566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.697681 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.697724 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.697905 (+ 181us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.698270 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":161}
I20260929 06:38:37.698792 23339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.683731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37754 (local address 127.15.157.188:38433)
0929 06:38:37.683852 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.683854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.684284 (+ 430us) server_negotiation.cc:407] Connection header received
0929 06:38:37.684358 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.684359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.684371 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.684429 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:37.685186 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.688460 (+ 3274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.689591 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.689901 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.690004 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.691311 (+ 1307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:37.691312 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:37.691313 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:37.691319 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:37.697272 (+ 5953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.697854 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.697855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.697856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.697916 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:37.698137 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:37.698137 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:37.698138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:37.698283 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:37.698382 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.698661 (+ 279us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.698728 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":82,"threads_started":1}
I20260929 06:38:37.698803 23328 heartbeater.cc:347] Connected to a master server at 127.15.157.189:45837
I20260929 06:38:37.698844 23328 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:37.698886 23328 heartbeater.cc:511] Master 127.15.157.189:45837 requested a full tablet report, sending...
I20260929 06:38:37.699208 22687 ts_manager.cc:194] Registered new tserver with Master: 7be196a581b047d29464880bf68c01d0 (127.15.157.131:46633)
I20260929 06:38:37.699136 22089 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43272:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:38:37.700754 22089 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:37.707819 22647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.704253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:39687 (local address 127.0.0.1:46228)
0929 06:38:37.704452 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.704463 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.704506 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.704936 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.704937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.704939 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:37.704983 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.704984 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.706043 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.706044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.706930 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.706933 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.707602 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.707603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.707661 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.707664 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.707705 (+ 41us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.707747 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181}
I20260929 06:38:37.708114 23349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.704377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46228 (local address 127.15.157.129:39687)
0929 06:38:37.704766 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.704771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.704779 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:37.704812 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.704814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.704860 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.704941 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:37.705061 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.705948 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.707024 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.707506 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.707619 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.707677 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.707715 (+ 38us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.707748 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":76,"threads_started":1}
I20260929 06:38:37.708611 23348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.704269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:42155 (local address 127.0.0.1:60150)
0929 06:38:37.704585 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.704595 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.704640 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.705208 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.705209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.705212 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:37.705264 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.705265 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.706668 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.706668 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.707425 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.707427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.708377 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.708378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.708437 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.708440 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.708493 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.708540 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":26,"thread_start_us":98,"threads_started":1}
I20260929 06:38:37.708640 23350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.704457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60150 (local address 127.15.157.130:42155)
0929 06:38:37.705056 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.705061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.705069 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:37.705103 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.705105 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.705126 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.705185 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:37.705349 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.706467 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.707522 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.708218 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.708301 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.708346 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.708522 (+ 176us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.708565 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":71,"threads_started":1}
I20260929 06:38:37.708832 22987 tablet_service.cc:1467] Processing CreateTablet for tablet 7a54f7ada7904156bf172d49f69148dc (DEFAULT_TABLE table=test-table [id=f578b47d39aa49febf889f0051bb8ae9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:37.709151 22987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a54f7ada7904156bf172d49f69148dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:37.709268 23124 tablet_service.cc:1467] Processing CreateTablet for tablet 7a54f7ada7904156bf172d49f69148dc (DEFAULT_TABLE table=test-table [id=f578b47d39aa49febf889f0051bb8ae9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:37.709622 23124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a54f7ada7904156bf172d49f69148dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:37.709702 23347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.704369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:46633 (local address 127.0.0.1:50584)
0929 06:38:37.704597 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.704605 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.704642 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.705425 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.705426 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.705427 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:37.705459 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.705461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.706627 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.706628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.708490 (+ 1862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.708492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.709455 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.709456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.709515 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.709520 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.709568 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.709607 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":41,"thread_start_us":78,"threads_started":1}
I20260929 06:38:37.709976 23351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.704548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50584 (local address 127.15.157.131:46633)
0929 06:38:37.705268 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.705271 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.705277 (+ 6us) server_negotiation.cc:407] Connection header received
0929 06:38:37.705301 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.705325 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.705340 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.705417 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:37.705513 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.706540 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.708571 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.709283 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.709370 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.709419 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.709838 (+ 419us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.709879 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":65,"threads_started":1}
I20260929 06:38:37.710644 23260 tablet_service.cc:1467] Processing CreateTablet for tablet 7a54f7ada7904156bf172d49f69148dc (DEFAULT_TABLE table=test-table [id=f578b47d39aa49febf889f0051bb8ae9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:37.710961 23260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a54f7ada7904156bf172d49f69148dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:37.712019 23352 tablet_bootstrap.cc:492] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd: Bootstrap starting.
I20260929 06:38:37.712634 23352 tablet_bootstrap.cc:654] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:37.712932 23352 log.cc:824] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:37.713434 23353 tablet_bootstrap.cc:492] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e: Bootstrap starting.
I20260929 06:38:37.713660 23352 tablet_bootstrap.cc:492] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd: No bootstrap required, opened a new log
I20260929 06:38:37.713737 23352 ts_tablet_manager.cc:1397] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:38:37.714061 23353 tablet_bootstrap.cc:654] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:37.714399 23353 log.cc:824] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:37.714550 23355 tablet_bootstrap.cc:492] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0: Bootstrap starting.
I20260929 06:38:37.715080 23353 tablet_bootstrap.cc:492] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e: No bootstrap required, opened a new log
I20260929 06:38:37.715130 23353 ts_tablet_manager.cc:1397] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 06:38:37.715646 23355 tablet_bootstrap.cc:654] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:37.715971 23355 log.cc:824] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:37.716265 23352 raft_consensus.cc:348] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } } peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } }
I20260929 06:38:37.716420 23352 raft_consensus.cc:374] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:37.716462 23352 raft_consensus.cc:729] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6474efaac22405e840b064c9f85f2bd, State: Initialized, Role: FOLLOWER
I20260929 06:38:37.716583 23352 consensus_queue.cc:260] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } } peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } }
I20260929 06:38:37.716843 23352 ts_tablet_manager.cc:1428] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:38:37.716967 23054 heartbeater.cc:503] Master 127.15.157.190:45285 was elected leader, sending a full tablet report...
I20260929 06:38:37.716873 23355 tablet_bootstrap.cc:492] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0: No bootstrap required, opened a new log
I20260929 06:38:37.717131 23355 ts_tablet_manager.cc:1397] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:38:37.717859 23353 raft_consensus.cc:348] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } } peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } }
I20260929 06:38:37.718011 23353 raft_consensus.cc:374] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:37.718081 23353 raft_consensus.cc:729] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be05363333594e1ea376d3017d0a3c0e, State: Initialized, Role: FOLLOWER
I20260929 06:38:37.718199 23353 consensus_queue.cc:260] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } } peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } }
I20260929 06:38:37.718437 23353 ts_tablet_manager.cc:1428] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260929 06:38:37.718479 23191 heartbeater.cc:503] Master 127.15.157.190:45285 was elected leader, sending a full tablet report...
I20260929 06:38:37.719635 23355 raft_consensus.cc:348] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } } peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } }
I20260929 06:38:37.719801 23355 raft_consensus.cc:374] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:37.719841 23355 raft_consensus.cc:729] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be196a581b047d29464880bf68c01d0, State: Initialized, Role: FOLLOWER
I20260929 06:38:37.719954 23355 consensus_queue.cc:260] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } } peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } }
I20260929 06:38:37.720227 23355 ts_tablet_manager.cc:1428] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:38:37.720347 23327 heartbeater.cc:503] Master 127.15.157.190:45285 was elected leader, sending a full tablet report...
W20260929 06:38:37.784456 23193 tablet.cc:2369] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:38:37.818305 23339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.815954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37760 (local address 127.15.157.188:38433)
0929 06:38:37.816020 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:37.816022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:37.816031 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:37.816083 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:37.816084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:37.816100 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:37.816158 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:37.816285 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.816769 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.817600 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.817984 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.818110 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.818169 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:37.818218 (+ 49us) server_negotiation.cc:299] Negotiation successful
0929 06:38:37.818248 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 06:38:37.818310 23347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:37.815864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:38433 (local address 127.0.0.1:37760)
0929 06:38:37.815948 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:37.815962 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:37.816030 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:37.816176 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:37.816176 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:37.816178 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:37.816225 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.816226 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.816829 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.816829 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.817526 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:37.817528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:37.818123 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:37.818123 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:37.818164 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:37.818168 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:38:37.818211 (+ 43us) client_negotiation.cc:240] Negotiation successful
0929 06:38:37.818247 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260929 06:38:37.818765 22884 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260929 06:38:37.819614 22913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4540dd34fb5d4c96b0e4a7ebea42d091. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } } }
I20260929 06:38:37.819722 22913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [sys.catalog]: This master's current role is: LEARNER
W20260929 06:38:37.879776 23056 tablet.cc:2369] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:38:37.930665 23329 tablet.cc:2369] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:38:38.001011 23358 raft_consensus.cc:482] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:38.001119 23358 raft_consensus.cc:504] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } } peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } }
I20260929 06:38:38.001417 23358 leader_election.cc:288] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be05363333594e1ea376d3017d0a3c0e (127.15.157.130:42155), 7be196a581b047d29464880bf68c01d0 (127.15.157.131:46633)
I20260929 06:38:38.004652 23351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:38.001693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:38007 (local address 127.15.157.131:46633)
0929 06:38:38.001758 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:38.001760 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:38.001792 (+ 32us) server_negotiation.cc:407] Connection header received
0929 06:38:38.001876 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:38.001877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:38.001887 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:38.001940 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:38.002257 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.002780 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.003804 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.004310 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.004383 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:38.004393 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:38.004535 (+ 142us) server_negotiation.cc:299] Negotiation successful
0929 06:38:38.004577 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 06:38:38.004681 23350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:38.001740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:42657 (local address 127.15.157.130:42155)
0929 06:38:38.001781 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:38.001783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:38.001792 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:38.001867 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:38.001868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:38.001877 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:38.001940 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:38.002180 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.002674 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.003928 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.004318 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.004401 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:38.004409 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:38.004580 (+ 171us) server_negotiation.cc:299] Negotiation successful
0929 06:38:38.004622 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:38:38.004683 23365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:38.001605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:46633 (local address 127.15.157.129:38007)
0929 06:38:38.001728 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:38.001740 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:38.001802 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:38.001964 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:38.001965 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:38.001967 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:38.002085 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:38.002086 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.002865 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.002867 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:38.003728 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:38.003730 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.004384 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.004385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:38.004458 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:38.004462 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:38:38.004515 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 06:38:38.004574 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":3,"thread_start_us":56,"threads_started":1}
I20260929 06:38:38.004694 23364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:38.001605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:42155 (local address 127.15.157.129:42657)
0929 06:38:38.001727 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:38.001740 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:38.001800 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:38.001965 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:38.001966 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:38.001968 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:38.002075 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:38.002077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.002802 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.002804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:38.003811 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:38.003813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.004409 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.004410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:38.004484 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:38.004487 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:38:38.004560 (+ 73us) client_negotiation.cc:240] Negotiation successful
0929 06:38:38.004598 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":85,"thread_start_us":60,"threads_started":1}
I20260929 06:38:38.005194 23144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a54f7ada7904156bf172d49f69148dc" candidate_uuid: "c6474efaac22405e840b064c9f85f2bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be05363333594e1ea376d3017d0a3c0e" is_pre_election: true
I20260929 06:38:38.005214 23280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a54f7ada7904156bf172d49f69148dc" candidate_uuid: "c6474efaac22405e840b064c9f85f2bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be196a581b047d29464880bf68c01d0" is_pre_election: true
I20260929 06:38:38.005352 23144 raft_consensus.cc:2454] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6474efaac22405e840b064c9f85f2bd in term 0.
I20260929 06:38:38.005360 23280 raft_consensus.cc:2454] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6474efaac22405e840b064c9f85f2bd in term 0.
I20260929 06:38:38.005568 22940 leader_election.cc:302] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be05363333594e1ea376d3017d0a3c0e, c6474efaac22405e840b064c9f85f2bd; no voters:
I20260929 06:38:38.005726 23358 raft_consensus.cc:2781] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:38.005800 23358 raft_consensus.cc:482] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:38.005824 23358 raft_consensus.cc:3037] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:38.006516 23358 raft_consensus.cc:504] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } } peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } }
I20260929 06:38:38.006659 23358 leader_election.cc:288] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [CANDIDATE]: Term 1 election: Requested vote from peers be05363333594e1ea376d3017d0a3c0e (127.15.157.130:42155), 7be196a581b047d29464880bf68c01d0 (127.15.157.131:46633)
I20260929 06:38:38.006801 23144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a54f7ada7904156bf172d49f69148dc" candidate_uuid: "c6474efaac22405e840b064c9f85f2bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be05363333594e1ea376d3017d0a3c0e"
I20260929 06:38:38.006821 23280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a54f7ada7904156bf172d49f69148dc" candidate_uuid: "c6474efaac22405e840b064c9f85f2bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be196a581b047d29464880bf68c01d0"
I20260929 06:38:38.006876 23144 raft_consensus.cc:3037] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:38.006887 23280 raft_consensus.cc:3037] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:38.007766 23280 raft_consensus.cc:2454] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6474efaac22405e840b064c9f85f2bd in term 1.
I20260929 06:38:38.007838 23144 raft_consensus.cc:2454] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6474efaac22405e840b064c9f85f2bd in term 1.
I20260929 06:38:38.007966 22940 leader_election.cc:302] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be05363333594e1ea376d3017d0a3c0e, c6474efaac22405e840b064c9f85f2bd; no voters:
I20260929 06:38:38.008062 23358 raft_consensus.cc:2781] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:38.008172 23358 raft_consensus.cc:686] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [term 1 LEADER]: Becoming Leader. State: Replica: c6474efaac22405e840b064c9f85f2bd, State: Running, Role: LEADER
I20260929 06:38:38.008272 23358 consensus_queue.cc:237] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } } peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } }
I20260929 06:38:38.009116 22089 catalog_manager.cc:5495] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd reported cstate change: term changed from 0 to 1, leader changed from <none> to c6474efaac22405e840b064c9f85f2bd (127.15.157.129). New cstate: current_term: 1 leader_uuid: "c6474efaac22405e840b064c9f85f2bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } health_report { overall_health: UNKNOWN } } }
I20260929 06:38:38.009728 22838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: NON_VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: true } } }
I20260929 06:38:38.009811 22838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:38.010375 22840 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091: attempting to promote NON_VOTER 094f8cde633246d68c7609971002819a to VOTER
I20260929 06:38:38.010548 22840 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } }
I20260929 06:38:38.011020 22884 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 1 LEARNER]: Refusing update from remote peer 4540dd34fb5d4c96b0e4a7ebea42d091: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260929 06:38:38.011121 22697 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 FOLLOWER]: Refusing update from remote peer 4540dd34fb5d4c96b0e4a7ebea42d091: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260929 06:38:38.011255 23371 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260929 06:38:38.011374 22838 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260929 06:38:38.012023 23370 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 094f8cde633246d68c7609971002819a (127.15.157.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } } }
I20260929 06:38:38.012162 22697 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 094f8cde633246d68c7609971002819a (127.15.157.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } } }
I20260929 06:38:38.012161 22884 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 094f8cde633246d68c7609971002819a (127.15.157.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } } }
I20260929 06:38:38.013041 22913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } } }
I20260929 06:38:38.013055 23372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } } }
I20260929 06:38:38.013125 22913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:38.013142 23372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:38.013208 23370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } } }
I20260929 06:38:38.013270 22840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } } }
I20260929 06:38:38.013268 22838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } } }
I20260929 06:38:38.013428 22838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:38.013290 23370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:38.013350 22840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:38.064208 23349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:38.062035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46240 (local address 127.15.157.129:39687)
0929 06:38:38.062078 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:38.062079 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:38.062089 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:38:38.062164 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:38.062165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:38.062182 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:38.062241 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:38.062410 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.062891 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.063572 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.063776 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.063827 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:38.063953 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:38.064047 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:38.064105 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:38.064136 (+ 31us) server_negotiation.cc:299] Negotiation successful
0929 06:38:38.064152 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:38.065963 23280 raft_consensus.cc:1261] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0 [term 1 FOLLOWER]: Refusing update from remote peer c6474efaac22405e840b064c9f85f2bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:38.066000 23144 raft_consensus.cc:1261] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e [term 1 FOLLOWER]: Refusing update from remote peer c6474efaac22405e840b064c9f85f2bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:38.066397 23366 consensus_queue.cc:1035] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:38.066536 23358 consensus_queue.cc:1035] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:38.069806 23376 mvcc.cc:205] Tried to move back new op lower bound from 7334559408395673600 to 7334559408162594816. Current Snapshot: MvccSnapshot[applied={T|T < 7334559408395673600}]
I20260929 06:38:38.070066 23375 mvcc.cc:205] Tried to move back new op lower bound from 7334559408395673600 to 7334559408162594816. Current Snapshot: MvccSnapshot[applied={T|T < 7334559408395673600}]
I20260929 06:38:38.072230 22089 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:38.072331 22089 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:38.074304 22089 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4540dd34fb5d4c96b0e4a7ebea42d091: Sending DeleteTablet for 3 replicas of tablet 7a54f7ada7904156bf172d49f69148dc
I20260929 06:38:38.074577 23124 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a54f7ada7904156bf172d49f69148dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:38 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:60150
I20260929 06:38:38.074611 22987 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a54f7ada7904156bf172d49f69148dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:38 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:46228
I20260929 06:38:38.074745 23260 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a54f7ada7904156bf172d49f69148dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:38 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:50584
I20260929 06:38:38.074874 23383 tablet_replica.cc:330] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e: stopping tablet replica
I20260929 06:38:38.074949 23385 tablet_replica.cc:330] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0: stopping tablet replica
I20260929 06:38:38.074982 23383 raft_consensus.cc:2229] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:38.075026 23385 raft_consensus.cc:2229] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:38.075088 23383 raft_consensus.cc:2258] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:38.075111 23385 raft_consensus.cc:2258] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:38.075237 23384 tablet_replica.cc:330] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd: stopping tablet replica
I20260929 06:38:38.075333 23384 raft_consensus.cc:2229] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:38:38.075445 23384 raft_consensus.cc:2258] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:38.075582 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 22057
I20260929 06:38:38.075676 23383 ts_tablet_manager.cc:1905] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:38.076218 23385 ts_tablet_manager.cc:1905] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:38.077526 23383 ts_tablet_manager.cc:1918] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:38.077605 23383 log.cc:1196] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/7a54f7ada7904156bf172d49f69148dc
I20260929 06:38:38.077816 23385 ts_tablet_manager.cc:1918] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:38.077889 23385 log.cc:1196] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/7a54f7ada7904156bf172d49f69148dc
I20260929 06:38:38.077896 23383 ts_tablet_manager.cc:1939] T 7a54f7ada7904156bf172d49f69148dc P be05363333594e1ea376d3017d0a3c0e: Deleting consensus metadata
I20260929 06:38:38.078195 23385 ts_tablet_manager.cc:1939] T 7a54f7ada7904156bf172d49f69148dc P 7be196a581b047d29464880bf68c01d0: Deleting consensus metadata
I20260929 06:38:38.078841 23384 ts_tablet_manager.cc:1905] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:38.080241 23384 ts_tablet_manager.cc:1918] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:38.080309 23384 log.cc:1196] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-0/wal/wals/7a54f7ada7904156bf172d49f69148dc
I20260929 06:38:38.080574 23384 ts_tablet_manager.cc:1939] T 7a54f7ada7904156bf172d49f69148dc P c6474efaac22405e840b064c9f85f2bd: Deleting consensus metadata
W20260929 06:38:38.081933 23215 connection.cc:535] server connection from 127.0.0.1:50584 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260929 06:38:38.082113 23077 connection.cc:535] server connection from 127.0.0.1:60150 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260929 06:38:38.082242 22943 connection.cc:535] server connection from 127.0.0.1:46228 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 06:38:38.092522 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:38.083959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59592 (local address 127.15.157.189:45837)
0929 06:38:38.083995 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:38.083997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:38.084003 (+ 6us) server_negotiation.cc:407] Connection header received
0929 06:38:38.084023 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:38.084024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:38.084033 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:38.084081 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:38.084758 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.085529 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.086654 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.086946 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.086983 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:38.088831 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:38.088833 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:38.088833 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:38.088841 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:38.091069 (+ 2228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:38.091608 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:38.091609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:38.091609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:38.091676 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:38.091907 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:38.091908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:38.091908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:38.092030 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:38.092101 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:38.092347 (+ 246us) server_negotiation.cc:299] Negotiation successful
0929 06:38:38.092424 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:38:38.092522 23059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:38.083922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37778 (local address 127.15.157.188:38433)
0929 06:38:38.083960 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:38.083961 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:38.084042 (+ 81us) server_negotiation.cc:407] Connection header received
0929 06:38:38.084132 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:38.084133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:38.084144 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:38.084195 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:38.084816 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.085298 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.086824 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.087107 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.087145 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:38.088831 (+ 1686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:38.088833 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:38.088833 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:38.088841 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:38.091114 (+ 2273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:38.091608 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:38.091609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:38.091609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:38.091676 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:38.091900 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:38.091901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:38.091901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:38.092030 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:38.092101 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:38.092351 (+ 250us) server_negotiation.cc:299] Negotiation successful
0929 06:38:38.092424 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:38.092767 23339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:38.075248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37776 (local address 127.15.157.188:38433)
0929 06:38:38.075291 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:38.075293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:38.082203 (+ 6910us) server_negotiation.cc:407] Connection header received
0929 06:38:38.082335 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:38.082336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:38.082348 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:38.082381 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:38.086123 (+ 3742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.086846 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.087869 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:38.088165 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:38.088214 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:38.089633 (+ 1419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:38.089634 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:38.089635 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:38.089641 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:38.091548 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:38.091935 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:38.091936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:38.091936 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:38.091986 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:38.092173 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:38.092173 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:38.092174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:38.092309 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:38.092375 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:38.092569 (+ 194us) server_negotiation.cc:299] Negotiation successful
0929 06:38:38.092649 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:38:39.070514 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.070177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.130:34021)
0929 06:38:39.070370 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.070453 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":72,"threads_started":1}
W20260929 06:38:39.070776 23191 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:45285 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
I20260929 06:38:39.071079 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.070440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.129:40343)
0929 06:38:39.070966 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.071031 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":52,"threads_started":1}
I20260929 06:38:39.071117 23395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.070565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.131:39821)
0929 06:38:39.070972 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.071069 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":49,"threads_started":1}
W20260929 06:38:39.071269 23054 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:45285 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
W20260929 06:38:39.071333 23327 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:45285 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
I20260929 06:38:39.574497 23396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4540dd34fb5d4c96b0e4a7ebea42d091)
I20260929 06:38:39.574625 23396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } }
I20260929 06:38:39.574874 23396 leader_election.cc:288] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4540dd34fb5d4c96b0e4a7ebea42d091 (127.15.157.190:45285), 094f8cde633246d68c7609971002819a (127.15.157.188:38433)
I20260929 06:38:39.574934 23397 raft_consensus.cc:482] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4540dd34fb5d4c96b0e4a7ebea42d091)
I20260929 06:38:39.575094 23397 raft_consensus.cc:504] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } }
I20260929 06:38:39.575201 23398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.574964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.0.0.1:43750)
0929 06:38:39.575101 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.575153 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":47,"threads_started":1}
W20260929 06:38:39.575366 22674 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
I20260929 06:38:39.575778 23402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.575497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.0.0.1:43752)
0929 06:38:39.575671 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.575715 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":92,"threads_started":1}
I20260929 06:38:39.575783 23398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.575694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.0.0.1:43762)
0929 06:38:39.575726 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.575758 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260929 06:38:39.575847 22674 leader_election.cc:334] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4540dd34fb5d4c96b0e4a7ebea42d091 (127.15.157.190:45285): Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
I20260929 06:38:39.575922 23397 leader_election.cc:288] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4540dd34fb5d4c96b0e4a7ebea42d091 (127.15.157.190:45285), 2fe578c668a549c58263b9d014a0b76f (127.15.157.189:45837)
W20260929 06:38:39.575940 22861 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
I20260929 06:38:39.576388 23402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.576294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.0.0.1:43764)
0929 06:38:39.576329 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.576361 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260929 06:38:39.576475 22861 leader_election.cc:334] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4540dd34fb5d4c96b0e4a7ebea42d091 (127.15.157.190:45285): Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
I20260929 06:38:39.578431 23400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.575110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37784 (local address 127.15.157.188:38433)
0929 06:38:39.575190 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:39.575192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:39.575249 (+ 57us) server_negotiation.cc:407] Connection header received
0929 06:38:39.575338 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:39.575339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:39.575350 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:39.575409 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:39.575611 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.576394 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.577639 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.578056 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.578152 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:39.578162 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:39.578320 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 06:38:39.578364 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63,"thread_start_us":38,"threads_started":1}
I20260929 06:38:39.578464 23399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.575000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:38433 (local address 127.0.0.1:37784)
0929 06:38:39.575143 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.575178 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:39.575248 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:39.575434 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:39.575435 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:39.575438 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:39.575500 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:39.575503 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.576499 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.576500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:39.577557 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:39.577559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.578151 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.578152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:39.578219 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:39.578222 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:38:39.578312 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 06:38:39.578386 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":22,"thread_start_us":48,"threads_started":1}
I20260929 06:38:39.578682 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2fe578c668a549c58263b9d014a0b76f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "094f8cde633246d68c7609971002819a" is_pre_election: true
I20260929 06:38:39.578799 22884 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fe578c668a549c58263b9d014a0b76f in term 1.
I20260929 06:38:39.578939 22673 leader_election.cc:302] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 094f8cde633246d68c7609971002819a, 2fe578c668a549c58263b9d014a0b76f; no voters: 4540dd34fb5d4c96b0e4a7ebea42d091
I20260929 06:38:39.579073 23396 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 06:38:39.579098 23403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.575811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45837 (local address 127.0.0.1:59604)
0929 06:38:39.575994 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.576003 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:39.576057 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:39.576259 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:39.576260 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:39.576262 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:39.576304 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:39.576305 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.577300 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.577301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:39.578121 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:39.578123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.578839 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.578840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:39.578909 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:39.578913 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:38:39.578979 (+ 66us) client_negotiation.cc:240] Negotiation successful
0929 06:38:39.579022 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":48,"threads_started":1}
I20260929 06:38:39.579126 23396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4540dd34fb5d4c96b0e4a7ebea42d091)
I20260929 06:38:39.579151 23396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 1 FOLLOWER]: Advancing to term 2
I20260929 06:38:39.579228 23405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.576028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59604 (local address 127.15.157.189:45837)
0929 06:38:39.576152 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:39.576153 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:39.576161 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:39.576182 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:39.576183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:39.576194 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:39.576257 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:39.576364 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.577220 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.578228 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.578747 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.578825 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:39.578834 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:39.578984 (+ 150us) server_negotiation.cc:299] Negotiation successful
0929 06:38:39.579043 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":76,"threads_started":1}
I20260929 06:38:39.579396 22697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "094f8cde633246d68c7609971002819a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2fe578c668a549c58263b9d014a0b76f" is_pre_election: true
I20260929 06:38:39.580036 23396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } }
I20260929 06:38:39.580174 22697 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 094f8cde633246d68c7609971002819a in current term 2: Already voted for candidate 2fe578c668a549c58263b9d014a0b76f in this term.
I20260929 06:38:39.580193 23396 leader_election.cc:288] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [CANDIDATE]: Term 2 election: Requested vote from peers 4540dd34fb5d4c96b0e4a7ebea42d091 (127.15.157.190:45285), 094f8cde633246d68c7609971002819a (127.15.157.188:38433)
I20260929 06:38:39.580324 22884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2fe578c668a549c58263b9d014a0b76f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "094f8cde633246d68c7609971002819a"
I20260929 06:38:39.580397 22884 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 1 FOLLOWER]: Advancing to term 2
I20260929 06:38:39.580403 22859 leader_election.cc:302] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 094f8cde633246d68c7609971002819a; no voters: 2fe578c668a549c58263b9d014a0b76f, 4540dd34fb5d4c96b0e4a7ebea42d091
I20260929 06:38:39.580439 23399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.580262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.0.0.1:43774)
0929 06:38:39.580383 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.580413 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260929 06:38:39.580824 23399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.580733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.0.0.1:43790)
0929 06:38:39.580776 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.580800 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260929 06:38:39.580873 22674 leader_election.cc:334] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4540dd34fb5d4c96b0e4a7ebea42d091 (127.15.157.190:45285): Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
I20260929 06:38:39.581043 22884 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fe578c668a549c58263b9d014a0b76f in term 2.
I20260929 06:38:39.581112 23397 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:38:39.581211 22673 leader_election.cc:302] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 094f8cde633246d68c7609971002819a, 2fe578c668a549c58263b9d014a0b76f; no voters: 4540dd34fb5d4c96b0e4a7ebea42d091
I20260929 06:38:39.581295 23396 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 2 FOLLOWER]: Leader election won for term 2
I20260929 06:38:39.581456 23396 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [term 2 LEADER]: Becoming Leader. State: Replica: 2fe578c668a549c58263b9d014a0b76f, State: Running, Role: LEADER
I20260929 06:38:39.581542 23396 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } }
I20260929 06:38:39.581878 23406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fe578c668a549c58263b9d014a0b76f. Latest consensus state: current_term: 2 leader_uuid: "2fe578c668a549c58263b9d014a0b76f" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } } }
I20260929 06:38:39.581974 23406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:39.582167 23408 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:39.582731 23408 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:39.582815 23408 catalog_manager.cc:1259] Loaded cluster ID: c8ae0126f5d44dd094c05a68c82a1f71
I20260929 06:38:39.582849 23408 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:39.583020 23408 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:39.583082 23408 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: Loaded TSK: 0
I20260929 06:38:39.583223 23408 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:38:39.631287 22686 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59592:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:38:39.632964 22686 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:39.633944 23399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.633824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.0.0.1:43820)
0929 06:38:39.633881 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.633914 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260929 06:38:39.633936 22884 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [term 2 FOLLOWER]: Refusing update from remote peer 2fe578c668a549c58263b9d014a0b76f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260929 06:38:39.634250 23396 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [LEADER]: Connected to new peer: Peer: permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260929 06:38:39.634410 23399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.634294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.0.0.1:43826)
0929 06:38:39.634337 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.634383 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 06:38:39.634476 22674 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f -> Peer 4540dd34fb5d4c96b0e4a7ebea42d091 (127.15.157.190:45285): Couldn't send request to peer 4540dd34fb5d4c96b0e4a7ebea42d091. Status: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 06:38:39.634939 23397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fe578c668a549c58263b9d014a0b76f. Latest consensus state: current_term: 2 leader_uuid: "2fe578c668a549c58263b9d014a0b76f" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } } }
I20260929 06:38:39.635042 23397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:39.635578 23410 mvcc.cc:205] Tried to move back new op lower bound from 7334559414818869248 to 7334559414606704640. Current Snapshot: MvccSnapshot[applied={T|T < 7334559414818869248}]
I20260929 06:38:39.635823 23397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "2fe578c668a549c58263b9d014a0b76f" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } } }
I20260929 06:38:39.635919 23397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 094f8cde633246d68c7609971002819a [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:39.635463 23406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "2fe578c668a549c58263b9d014a0b76f" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "4540dd34fb5d4c96b0e4a7ebea42d091" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45285 } } peers { permanent_uuid: "2fe578c668a549c58263b9d014a0b76f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45837 } attrs { promote: false } } peers { permanent_uuid: "094f8cde633246d68c7609971002819a" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 38433 } attrs { promote: false } } }
I20260929 06:38:39.636159 23406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:39.640635 23398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.637316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:42155 (local address 127.0.0.1:60156)
0929 06:38:39.637521 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.637532 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:39.637596 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:39.637900 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:39.637901 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:39.637904 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:39.637983 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:39.637987 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.638908 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.638909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:39.639700 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:39.639702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.640380 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.640382 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:39.640448 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:39.640451 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:38:39.640527 (+ 76us) client_negotiation.cc:240] Negotiation successful
0929 06:38:39.640565 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189}
I20260929 06:38:39.640657 23418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.637577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60156 (local address 127.15.157.130:42155)
0929 06:38:39.637678 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:39.637680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:39.637687 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:39.637717 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:39.637717 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:39.637726 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:39.637897 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:39.638095 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.638824 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.639794 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.640288 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.640381 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:39.640390 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:39.640534 (+ 144us) server_negotiation.cc:299] Negotiation successful
0929 06:38:39.640577 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":54,"threads_started":1}
I20260929 06:38:39.641085 23399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.637305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:46633 (local address 127.0.0.1:50596)
0929 06:38:39.637344 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.637356 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:39.637392 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:39.637942 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:39.637943 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:39.637944 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:39.637988 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:39.637989 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.639002 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.639003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:39.640103 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:39.640105 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.640866 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.640867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:39.640932 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:39.640937 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:38:39.640966 (+ 29us) client_negotiation.cc:240] Negotiation successful
0929 06:38:39.641003 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":1}
I20260929 06:38:39.641093 23124 tablet_service.cc:1467] Processing CreateTablet for tablet 59adcaee859d4afe94723cb72a8d1048 (DEFAULT_TABLE table=test-table [id=5b902388858d4e7ca9a71b90d6eb87ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:39.641199 23415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.637380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:39687 (local address 127.0.0.1:46244)
0929 06:38:39.637946 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.637956 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:39.638011 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:39.638297 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:39.638298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:39.638300 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:39.638333 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:39.638334 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.639188 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.639189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:39.640228 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:39.640230 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.640981 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.640982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:39.641028 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:39.641030 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:38:39.641074 (+ 44us) client_negotiation.cc:240] Negotiation successful
0929 06:38:39.641111 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":74,"threads_started":1}
I20260929 06:38:39.641252 23124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59adcaee859d4afe94723cb72a8d1048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:39.641384 23416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.637467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50596 (local address 127.15.157.131:46633)
0929 06:38:39.637690 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:39.637692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:39.637699 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:39.637723 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:39.637723 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:39.637756 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:39.637849 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:39.638132 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.638912 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.640197 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.640776 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.641258 (+ 482us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:39.641268 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:39.641286 (+ 18us) server_negotiation.cc:299] Negotiation successful
0929 06:38:39.641322 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":57,"threads_started":1}
I20260929 06:38:39.641387 23417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.637545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46244 (local address 127.15.157.129:39687)
0929 06:38:39.637650 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:39.637652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:39.638069 (+ 417us) server_negotiation.cc:407] Connection header received
0929 06:38:39.638168 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:39.638169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:39.638181 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:39.638254 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:39.638413 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.639097 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.640309 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.640887 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.640945 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:39.640953 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:39.641280 (+ 327us) server_negotiation.cc:299] Negotiation successful
0929 06:38:39.641324 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":52,"threads_started":1}
I20260929 06:38:39.641562 23260 tablet_service.cc:1467] Processing CreateTablet for tablet 59adcaee859d4afe94723cb72a8d1048 (DEFAULT_TABLE table=test-table [id=5b902388858d4e7ca9a71b90d6eb87ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:39.641698 23260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59adcaee859d4afe94723cb72a8d1048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:39.641680 22987 tablet_service.cc:1467] Processing CreateTablet for tablet 59adcaee859d4afe94723cb72a8d1048 (DEFAULT_TABLE table=test-table [id=5b902388858d4e7ca9a71b90d6eb87ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:39.641776 22987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59adcaee859d4afe94723cb72a8d1048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:39.642781 23419 tablet_bootstrap.cc:492] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e: Bootstrap starting.
I20260929 06:38:39.643126 23421 tablet_bootstrap.cc:492] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0: Bootstrap starting.
I20260929 06:38:39.643226 23419 tablet_bootstrap.cc:654] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:39.643488 23421 tablet_bootstrap.cc:654] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:39.643806 23420 tablet_bootstrap.cc:492] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd: Bootstrap starting.
I20260929 06:38:39.643857 23419 tablet_bootstrap.cc:492] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e: No bootstrap required, opened a new log
I20260929 06:38:39.643893 23419 ts_tablet_manager.cc:1397] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:39.644050 23421 tablet_bootstrap.cc:492] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0: No bootstrap required, opened a new log
I20260929 06:38:39.644114 23421 ts_tablet_manager.cc:1397] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:39.644098 23419 raft_consensus.cc:348] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } } peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } }
I20260929 06:38:39.644201 23420 tablet_bootstrap.cc:654] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:39.644232 23419 raft_consensus.cc:374] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:39.644291 23419 raft_consensus.cc:729] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be05363333594e1ea376d3017d0a3c0e, State: Initialized, Role: FOLLOWER
I20260929 06:38:39.644264 23421 raft_consensus.cc:348] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } } peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } }
I20260929 06:38:39.644327 23421 raft_consensus.cc:374] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:39.644371 23421 raft_consensus.cc:729] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be196a581b047d29464880bf68c01d0, State: Initialized, Role: FOLLOWER
I20260929 06:38:39.644394 23419 consensus_queue.cc:260] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } } peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } }
I20260929 06:38:39.644435 23421 consensus_queue.cc:260] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } } peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } }
I20260929 06:38:39.644562 23419 ts_tablet_manager.cc:1428] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260929 06:38:39.644624 23421 ts_tablet_manager.cc:1428] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:39.644761 23420 tablet_bootstrap.cc:492] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd: No bootstrap required, opened a new log
I20260929 06:38:39.644809 23420 ts_tablet_manager.cc:1397] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:39.644906 23420 raft_consensus.cc:348] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } } peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } }
I20260929 06:38:39.644966 23420 raft_consensus.cc:374] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:39.644987 23420 raft_consensus.cc:729] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6474efaac22405e840b064c9f85f2bd, State: Initialized, Role: FOLLOWER
I20260929 06:38:39.645031 23420 consensus_queue.cc:260] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } } peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } }
I20260929 06:38:39.645164 23420 ts_tablet_manager.cc:1428] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:39.645689 23428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.645421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.129:40143)
0929 06:38:39.645612 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.645652 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":83,"threads_started":1}
I20260929 06:38:39.645673 23328 heartbeater.cc:503] Master 127.15.157.189:45837 was elected leader, sending a full tablet report...
I20260929 06:38:39.646240 23192 heartbeater.cc:503] Master 127.15.157.189:45837 was elected leader, sending a full tablet report...
I20260929 06:38:39.646247 23430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.646052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.130:41985)
0929 06:38:39.646162 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.646196 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":73,"threads_started":1}
I20260929 06:38:39.646399 23429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.645430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.131:40843)
0929 06:38:39.646326 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.646367 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":864,"thread_start_us":76,"threads_started":1}
I20260929 06:38:39.646732 23430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.646623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.130:53253)
0929 06:38:39.646679 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.646707 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260929 06:38:39.646785 23055 heartbeater.cc:503] Master 127.15.157.189:45837 was elected leader, sending a full tablet report...
I20260929 06:38:39.647154 23428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.647046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.129:33653)
0929 06:38:39.647099 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.647131 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 06:38:39.696696 23427 raft_consensus.cc:482] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:39.696801 23427 raft_consensus.cc:504] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } } peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } }
I20260929 06:38:39.696974 23427 leader_election.cc:288] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be196a581b047d29464880bf68c01d0 (127.15.157.131:46633), be05363333594e1ea376d3017d0a3c0e (127.15.157.130:42155)
I20260929 06:38:39.697158 23280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59adcaee859d4afe94723cb72a8d1048" candidate_uuid: "c6474efaac22405e840b064c9f85f2bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be196a581b047d29464880bf68c01d0" is_pre_election: true
I20260929 06:38:39.697264 23280 raft_consensus.cc:2454] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6474efaac22405e840b064c9f85f2bd in term 0.
I20260929 06:38:39.697217 23144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59adcaee859d4afe94723cb72a8d1048" candidate_uuid: "c6474efaac22405e840b064c9f85f2bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be05363333594e1ea376d3017d0a3c0e" is_pre_election: true
I20260929 06:38:39.697312 23144 raft_consensus.cc:2454] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6474efaac22405e840b064c9f85f2bd in term 0.
I20260929 06:38:39.697481 22940 leader_election.cc:302] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be05363333594e1ea376d3017d0a3c0e, c6474efaac22405e840b064c9f85f2bd; no voters:
I20260929 06:38:39.697604 23427 raft_consensus.cc:2781] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:39.697645 23427 raft_consensus.cc:482] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:39.697674 23427 raft_consensus.cc:3037] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:39.698439 23427 raft_consensus.cc:504] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } } peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } }
I20260929 06:38:39.698582 23427 leader_election.cc:288] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [CANDIDATE]: Term 1 election: Requested vote from peers 7be196a581b047d29464880bf68c01d0 (127.15.157.131:46633), be05363333594e1ea376d3017d0a3c0e (127.15.157.130:42155)
I20260929 06:38:39.698728 23144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59adcaee859d4afe94723cb72a8d1048" candidate_uuid: "c6474efaac22405e840b064c9f85f2bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be05363333594e1ea376d3017d0a3c0e"
I20260929 06:38:39.698740 23280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59adcaee859d4afe94723cb72a8d1048" candidate_uuid: "c6474efaac22405e840b064c9f85f2bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be196a581b047d29464880bf68c01d0"
I20260929 06:38:39.698812 23144 raft_consensus.cc:3037] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:39.698809 23280 raft_consensus.cc:3037] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:39.699376 23144 raft_consensus.cc:2454] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6474efaac22405e840b064c9f85f2bd in term 1.
I20260929 06:38:39.699501 23280 raft_consensus.cc:2454] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6474efaac22405e840b064c9f85f2bd in term 1.
I20260929 06:38:39.699574 22940 leader_election.cc:302] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be05363333594e1ea376d3017d0a3c0e, c6474efaac22405e840b064c9f85f2bd; no voters:
I20260929 06:38:39.699687 23427 raft_consensus.cc:2781] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:39.699848 23427 raft_consensus.cc:686] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [term 1 LEADER]: Becoming Leader. State: Replica: c6474efaac22405e840b064c9f85f2bd, State: Running, Role: LEADER
I20260929 06:38:39.699918 23427 consensus_queue.cc:237] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } } peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } }
I20260929 06:38:39.700205 23428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.700104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.129:39499)
0929 06:38:39.700145 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.700181 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260929 06:38:39.700578 22687 catalog_manager.cc:5495] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd reported cstate change: term changed from 0 to 1, leader changed from <none> to c6474efaac22405e840b064c9f85f2bd (127.15.157.129). New cstate: current_term: 1 leader_uuid: "c6474efaac22405e840b064c9f85f2bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6474efaac22405e840b064c9f85f2bd" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39687 } health_report { overall_health: HEALTHY } } }
I20260929 06:38:39.713863 23417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.711744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46246 (local address 127.15.157.129:39687)
0929 06:38:39.711799 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:39.711800 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:39.711809 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:39.711851 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:39.711852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:39.711860 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:39.711903 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:39.711995 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.712458 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.713240 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:39.713421 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:39.713473 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:39.713620 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:39.713644 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:39.713680 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:39.713745 (+ 65us) server_negotiation.cc:299] Negotiation successful
0929 06:38:39.713762 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 06:38:39.714646 23280 raft_consensus.cc:1261] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0 [term 1 FOLLOWER]: Refusing update from remote peer c6474efaac22405e840b064c9f85f2bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:39.714675 23144 raft_consensus.cc:1261] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e [term 1 FOLLOWER]: Refusing update from remote peer c6474efaac22405e840b064c9f85f2bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:39.714872 23427 consensus_queue.cc:1035] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be196a581b047d29464880bf68c01d0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 46633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:39.714991 23431 consensus_queue.cc:1035] T 59adcaee859d4afe94723cb72a8d1048 P c6474efaac22405e840b064c9f85f2bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "be05363333594e1ea376d3017d0a3c0e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:39.715795 23429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.715682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.131:54527)
0929 06:38:39.715727 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.715758 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260929 06:38:39.716286 23434 mvcc.cc:205] Tried to move back new op lower bound from 7334559415149723648 to 7334559415091445760. Current Snapshot: MvccSnapshot[applied={T|T < 7334559415149723648}]
I20260929 06:38:39.716681 23428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.716587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.129:57699)
0929 06:38:39.716630 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.716654 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260929 06:38:39.715967 23430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.715741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.130:53279)
0929 06:38:39.715905 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.715937 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
I20260929 06:38:39.717567 23430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.717483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.130:52847)
0929 06:38:39.717519 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.717542 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260929 06:38:39.717640 22687 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59592:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:39.717738 22687 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59592:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:39.718277 23428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.718181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.129:39327)
0929 06:38:39.718225 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.718249 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 06:38:39.718691 23429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:39.718592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45285 (local address 127.15.157.131:52459)
0929 06:38:39.718631 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.718653 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:45285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260929 06:38:39.719218 22687 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fe578c668a549c58263b9d014a0b76f: Sending DeleteTablet for 3 replicas of tablet 59adcaee859d4afe94723cb72a8d1048
I20260929 06:38:39.719429 23124 tablet_service.cc:1514] Processing DeleteTablet for tablet 59adcaee859d4afe94723cb72a8d1048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:39 UTC) from {username='oryx', principal='oryx/127.15.157.189@KRBTEST.COM'} at 127.0.0.1:60156
I20260929 06:38:39.719496 23260 tablet_service.cc:1514] Processing DeleteTablet for tablet 59adcaee859d4afe94723cb72a8d1048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:39 UTC) from {username='oryx', principal='oryx/127.15.157.189@KRBTEST.COM'} at 127.0.0.1:50596
I20260929 06:38:39.719507 23259 tablet_service.cc:1514] Processing DeleteTablet for tablet 59adcaee859d4afe94723cb72a8d1048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:39 UTC) from {username='oryx', principal='oryx/127.15.157.189@KRBTEST.COM'} at 127.0.0.1:50596
I20260929 06:38:39.719708 23444 tablet_replica.cc:330] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0: stopping tablet replica
I20260929 06:38:39.719754 23443 tablet_replica.cc:330] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e: stopping tablet replica
I20260929 06:38:39.719765 23444 raft_consensus.cc:2229] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:39.719760 22987 tablet_service.cc:1514] Processing DeleteTablet for tablet 59adcaee859d4afe94723cb72a8d1048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:39 UTC) from {username='oryx', principal='oryx/127.15.157.189@KRBTEST.COM'} at 127.0.0.1:46244
I20260929 06:38:39.719798 23443 raft_consensus.cc:2229] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:39.719807 23444 raft_consensus.cc:2258] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:39.719838 23443 raft_consensus.cc:2258] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:39.719878 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 22834
I20260929 06:38:39.719909 22986 tablet_service.cc:1514] Processing DeleteTablet for tablet 59adcaee859d4afe94723cb72a8d1048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:39 UTC) from {username='oryx', principal='oryx/127.15.157.189@KRBTEST.COM'} at 127.0.0.1:46244
I20260929 06:38:39.720748 23443 ts_tablet_manager.cc:1905] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:39.720884 23444 ts_tablet_manager.cc:1905] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:39.722675 23443 ts_tablet_manager.cc:1918] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:39.722746 23443 log.cc:1196] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/59adcaee859d4afe94723cb72a8d1048
I20260929 06:38:39.722718 23444 ts_tablet_manager.cc:1918] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:39.722792 23444 log.cc:1196] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/59adcaee859d4afe94723cb72a8d1048
I20260929 06:38:39.723049 23444 ts_tablet_manager.cc:1939] T 59adcaee859d4afe94723cb72a8d1048 P 7be196a581b047d29464880bf68c01d0: Deleting consensus metadata
I20260929 06:38:39.723061 23443 ts_tablet_manager.cc:1939] T 59adcaee859d4afe94723cb72a8d1048 P be05363333594e1ea376d3017d0a3c0e: Deleting consensus metadata
I20260929 06:38:39.723367 22671 catalog_manager.cc:4841] TS be05363333594e1ea376d3017d0a3c0e (127.15.157.130:42155): tablet 59adcaee859d4afe94723cb72a8d1048 (table test-table [id=5b902388858d4e7ca9a71b90d6eb87ad]) successfully deleted
I20260929 06:38:39.723372 22673 catalog_manager.cc:4841] TS 7be196a581b047d29464880bf68c01d0 (127.15.157.131:46633): tablet 59adcaee859d4afe94723cb72a8d1048 (table test-table [id=5b902388858d4e7ca9a71b90d6eb87ad]) successfully deleted
W20260929 06:38:39.723554 22673 catalog_manager.cc:4808] TS 7be196a581b047d29464880bf68c01d0 (127.15.157.131:46633): delete failed for tablet 59adcaee859d4afe94723cb72a8d1048 because the tablet was not found. No further retry: Not found: Tablet not found: 59adcaee859d4afe94723cb72a8d1048
W20260929 06:38:39.726577 23415 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:39.726459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:39687 (local address 127.0.0.1:46256)
0929 06:38:39.726500 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:39.726527 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:39687: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":22}
W20260929 06:38:39.726727 22674 catalog_manager.cc:4584] TS c6474efaac22405e840b064c9f85f2bd (127.15.157.129:39687): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 59adcaee859d4afe94723cb72a8d1048: Network error: Client connection negotiation failed: client connection to 127.15.157.129:39687: connect: Connection reset by peer (error 104)
I20260929 06:38:39.726797 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 23061
I20260929 06:38:39.731966 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 23197
I20260929 06:38:39.736465 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 22553
I20260929 06:38:39.741314 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 22741
2026-09-29T06:38:39Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (4767 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:39 dist-test-slave-ltw5 krb5kdc[23448](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:39 dist-test-slave-ltw5 krb5kdc[23448](info): set up 2 sockets
Sep 29 06:38:39 dist-test-slave-ltw5 krb5kdc[23448](info): commencing operation
krb5kdc: starting...
W20260929 06:38:40.778575 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:38:40 dist-test-slave-ltw5 krb5kdc[23448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663920, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:40Z Disabled control of system clock
WARNING: no policy specified for oryx/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.190.keytab.
Entry for principal oryx/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.190.keytab.
I20260929 06:38:40.898103 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45439
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.190.keytab
--principal=oryx/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:46377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:45439
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:40.977991 23461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:40.978252 23461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:40.978288 23461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:40.979422 23461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:40.979496 23461 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260929 06:38:40.979519 23461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:40.979540 23461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:40.979571 23461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:40.979595 23461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:40.981115 23461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:46377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:45439
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.190.keytab
--principal=oryx/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:40.981391 23461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:40.981614 23461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:40.986361 23466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:40.986449 23467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:40.986389 23469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:40.986593 23461 server_base.cc:1034] running on GCE node
I20260929 06:38:40.986807 23461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:40.987032 23461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:40.988169 23461 hybrid_clock.cc:648] HybridClock initialized: now 1790663920988157 us; error 28 us; skew 500 ppm
Sep 29 06:38:40 dist-test-slave-ltw5 krb5kdc[23448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663920, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:40.990655 23461 init.cc:377] Logged in from keytab as oryx/127.15.157.190@KRBTEST.COM (short username oryx)
I20260929 06:38:40.991094 23461 webserver.cc:460] Webserver started at http://127.15.157.190:43391/ using document root <none> and password file <none>
I20260929 06:38:40.991288 23461 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:40.991329 23461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:40.991413 23461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:40.992383 23461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "bef0983fb2864ba99052f2c0f68e9804"
format_stamp: "Formatted at 2026-09-29 06:38:40 on dist-test-slave-ltw5"
server_key: "a9fde23be853d2c77aaf4ee81cd35b8f"
server_key_iv: "c4118ae9a4f1d36c47bf4c375b4c3ca3"
server_key_version: "encryptionkey@0"
I20260929 06:38:40.992672 23461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "bef0983fb2864ba99052f2c0f68e9804"
format_stamp: "Formatted at 2026-09-29 06:38:40 on dist-test-slave-ltw5"
server_key: "a9fde23be853d2c77aaf4ee81cd35b8f"
server_key_iv: "c4118ae9a4f1d36c47bf4c375b4c3ca3"
server_key_version: "encryptionkey@0"
I20260929 06:38:40.993884 23461 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:40.994620 23476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:40.994794 23461 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:40.994858 23461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "bef0983fb2864ba99052f2c0f68e9804"
format_stamp: "Formatted at 2026-09-29 06:38:40 on dist-test-slave-ltw5"
server_key: "a9fde23be853d2c77aaf4ee81cd35b8f"
server_key_iv: "c4118ae9a4f1d36c47bf4c375b4c3ca3"
server_key_version: "encryptionkey@0"
I20260929 06:38:40.994953 23461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:41.021963 23461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:41.023940 23461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:41.024055 23461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:41.028700 23461 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:45439
I20260929 06:38:41.028738 23538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:45439 every 8 connection(s)
I20260929 06:38:41.029081 23461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:41.029738 23539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:41.032042 23539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804: Bootstrap starting.
I20260929 06:38:41.032653 23539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:41.032927 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 23461
I20260929 06:38:41.033001 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:41.032954 23539 log.cc:824] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:41.033186 15990 external_mini_cluster.cc:1428] Setting key 83d7c811c279f8ed508564c236f971a5
I20260929 06:38:41.033716 23539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804: No bootstrap required, opened a new log
I20260929 06:38:41.035928 23539 raft_consensus.cc:348] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0983fb2864ba99052f2c0f68e9804" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45439 } }
I20260929 06:38:41.036091 23539 raft_consensus.cc:374] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:41.036154 23539 raft_consensus.cc:729] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bef0983fb2864ba99052f2c0f68e9804, State: Initialized, Role: FOLLOWER
I20260929 06:38:41.036327 23539 consensus_queue.cc:260] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0983fb2864ba99052f2c0f68e9804" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45439 } }
I20260929 06:38:41.036432 23539 raft_consensus.cc:388] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:41.036477 23539 raft_consensus.cc:482] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:41.036526 23539 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:41.037055 23539 raft_consensus.cc:504] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0983fb2864ba99052f2c0f68e9804" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45439 } }
I20260929 06:38:41.037174 23539 leader_election.cc:302] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bef0983fb2864ba99052f2c0f68e9804; no voters:
I20260929 06:38:41.037370 23539 leader_election.cc:288] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:41.037400 23544 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:41.037509 23544 raft_consensus.cc:686] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [term 1 LEADER]: Becoming Leader. State: Replica: bef0983fb2864ba99052f2c0f68e9804, State: Running, Role: LEADER
I20260929 06:38:41.037642 23539 sys_catalog.cc:564] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:41.037645 23544 consensus_queue.cc:237] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0983fb2864ba99052f2c0f68e9804" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45439 } }
I20260929 06:38:41.038147 23546 sys_catalog.cc:455] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bef0983fb2864ba99052f2c0f68e9804. Latest consensus state: current_term: 1 leader_uuid: "bef0983fb2864ba99052f2c0f68e9804" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0983fb2864ba99052f2c0f68e9804" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45439 } } }
I20260929 06:38:41.038250 23546 sys_catalog.cc:458] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:41.038661 23545 sys_catalog.cc:455] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bef0983fb2864ba99052f2c0f68e9804" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0983fb2864ba99052f2c0f68e9804" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45439 } } }
I20260929 06:38:41.038745 23545 sys_catalog.cc:458] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:41.038874 23551 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:41.039394 23551 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:41.041059 23551 catalog_manager.cc:1347] Generated new cluster ID: 337726ae8d1b47738a70c2a780b769cc
I20260929 06:38:41.041110 23551 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663920, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
I20260929 06:38:41.047605 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.033768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56512 (local address 127.15.157.190:45439)
0929 06:38:41.033932 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.033941 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.033972 (+ 31us) server_negotiation.cc:407] Connection header received
0929 06:38:41.035906 (+ 1934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.035913 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.035962 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.036112 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:41.037019 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.038409 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.039598 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.040201 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.040310 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.043166 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:41.043170 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:41.043170 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:41.043182 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:41.045602 (+ 2420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.046012 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.046034 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.046034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.046143 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.046354 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.046354 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.046355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.046627 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:41.046760 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.047220 (+ 460us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.047392 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
I20260929 06:38:41.075027 23551 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:41.075805 23551 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:41.079139 23551 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804: Generated new TSK 0
I20260929 06:38:41.079319 23551 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.129.keytab.
Entry for principal oryx/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.129.keytab.
I20260929 06:38:41.113471 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45439
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.129.keytab
--principal=oryx/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:46377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:41.194548 23565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:41.194782 23565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:41.194823 23565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:41.196018 23565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:41.196094 23565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:41.196131 23565 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:38:41.196189 23565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:41.197795 23565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:46377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.129.keytab
--principal=oryx/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.157.190:45439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:41.198089 23565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:41.198321 23565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:41.203359 23571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:41.203361 23570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:41.203447 23565 server_base.cc:1034] running on GCE node
W20260929 06:38:41.203361 23573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:41.203821 23565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:41.204031 23565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:41.205178 23565 hybrid_clock.cc:648] HybridClock initialized: now 1790663921205166 us; error 28 us; skew 500 ppm
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663921, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:41.208523 23565 init.cc:377] Logged in from keytab as oryx/127.15.157.129@KRBTEST.COM (short username oryx)
I20260929 06:38:41.209043 23565 webserver.cc:460] Webserver started at http://127.15.157.129:44673/ using document root <none> and password file <none>
I20260929 06:38:41.209230 23565 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:41.209271 23565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:41.209358 23565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:41.210434 23565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "cc1c36a949b84bb69c391392f763e903"
format_stamp: "Formatted at 2026-09-29 06:38:41 on dist-test-slave-ltw5"
server_key: "458f4032f3db142cd8bb57ed8627d3a0"
server_key_iv: "fc1e8be1ba35ce2bf5283ed5e0fe79b6"
server_key_version: "encryptionkey@0"
I20260929 06:38:41.210747 23565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "cc1c36a949b84bb69c391392f763e903"
format_stamp: "Formatted at 2026-09-29 06:38:41 on dist-test-slave-ltw5"
server_key: "458f4032f3db142cd8bb57ed8627d3a0"
server_key_iv: "fc1e8be1ba35ce2bf5283ed5e0fe79b6"
server_key_version: "encryptionkey@0"
I20260929 06:38:41.212294 23565 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:41.213030 23580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:41.213186 23565 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:41.213274 23565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "cc1c36a949b84bb69c391392f763e903"
format_stamp: "Formatted at 2026-09-29 06:38:41 on dist-test-slave-ltw5"
server_key: "458f4032f3db142cd8bb57ed8627d3a0"
server_key_iv: "fc1e8be1ba35ce2bf5283ed5e0fe79b6"
server_key_version: "encryptionkey@0"
I20260929 06:38:41.213336 23565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:41.228354 23565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:41.230548 23565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:41.230664 23565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:41.231128 23565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:41.231194 23565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:41.231245 23565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:41.231277 23565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663921, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
I20260929 06:38:41.238632 23565 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:39627
I20260929 06:38:41.238730 23695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:39627 every 8 connection(s)
I20260929 06:38:41.239063 23565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:38:41.241353 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.231699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:50765 (local address 127.15.157.190:45439)
0929 06:38:41.231770 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.231773 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.231986 (+ 213us) server_negotiation.cc:407] Connection header received
0929 06:38:41.232459 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.232461 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.232474 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.232564 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:41.233427 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.234322 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.235423 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.235770 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.235833 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.238624 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:41.238626 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:41.238626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:41.238634 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:41.240081 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.240439 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.240440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.240440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.240489 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.240753 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.240754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.240754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.240854 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:41.240907 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.241211 (+ 304us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.241289 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 06:38:41.241451 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.231677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45439 (local address 127.15.157.129:50765)
0929 06:38:41.231852 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.231891 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.232366 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.232629 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.232632 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.233021 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:41.233319 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.233327 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.234445 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.234447 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.235326 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.235329 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.235859 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.235861 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.235989 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.236512 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:41.236524 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:41.238511 (+ 1987us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:41.240154 (+ 1643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:41.240158 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:41.240160 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:41.240373 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:41.240574 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:41.240575 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:41.240575 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:41.240680 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:41.240933 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:41.240939 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:41.241054 (+ 115us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.241144 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.241266 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
I20260929 06:38:41.241940 23696 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45439
I20260929 06:38:41.242046 23696 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:41.242236 23696 heartbeater.cc:511] Master 127.15.157.190:45439 requested a full tablet report, sending...
I20260929 06:38:41.242765 23493 ts_manager.cc:194] Registered new tserver with Master: cc1c36a949b84bb69c391392f763e903 (127.15.157.129:39627)
I20260929 06:38:41.243635 23493 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:50765
I20260929 06:38:41.248087 23702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.242959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45439 (local address 127.15.157.129:34493)
0929 06:38:41.243116 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.243128 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.243179 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.243304 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.243305 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.243444 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:41.243491 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.243492 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.244264 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.244265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.244833 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.244835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.245177 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.245177 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.245222 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.245644 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:41.245649 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:41.245935 (+ 286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:41.247273 (+ 1338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:41.247273 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:41.247274 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:41.247429 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:41.247604 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:41.247604 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:41.247604 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:41.247652 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:41.247863 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:41.247863 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:41.247898 (+ 35us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.247948 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.248021 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":97,"threads_started":1}
I20260929 06:38:41.248093 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.243040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:34493 (local address 127.15.157.190:45439)
0929 06:38:41.243079 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.243081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.243187 (+ 106us) server_negotiation.cc:407] Connection header received
0929 06:38:41.243238 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.243239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.243248 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.243301 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:41.243549 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.244169 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.244925 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.245106 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.245169 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.246083 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:41.246085 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:41.246085 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:41.246092 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:41.247194 (+ 1102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.247501 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.247502 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.247502 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.247547 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.247712 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.247713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.247713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.247811 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:41.247860 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.247977 (+ 117us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.248037 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:38:41.249101 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 23565
I20260929 06:38:41.249226 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:38:41.249420 15990 external_mini_cluster.cc:1428] Setting key 6fa56a18d9f13e06f2917dc7ac0df98a
WARNING: no policy specified for oryx/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.130.keytab.
Entry for principal oryx/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.130.keytab.
I20260929 06:38:41.275161 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45439
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.130.keytab
--principal=oryx/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:46377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:41.355317 23705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:41.355552 23705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:41.355577 23705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:41.356663 23705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:41.356700 23705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:41.356720 23705 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:38:41.356738 23705 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:41.358170 23705 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:46377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.130.keytab
--principal=oryx/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.157.190:45439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:41.358351 23705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:41.358520 23705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:41.363610 23710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:41.363754 23705 server_base.cc:1034] running on GCE node
W20260929 06:38:41.363641 23713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:41.363828 23711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:41.364032 23705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:41.364270 23705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:41.365435 23705 hybrid_clock.cc:648] HybridClock initialized: now 1790663921365434 us; error 40 us; skew 500 ppm
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663921, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:41.367822 23705 init.cc:377] Logged in from keytab as oryx/127.15.157.130@KRBTEST.COM (short username oryx)
I20260929 06:38:41.368243 23705 webserver.cc:460] Webserver started at http://127.15.157.130:45801/ using document root <none> and password file <none>
I20260929 06:38:41.368461 23705 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:41.368528 23705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:41.368677 23705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:41.369745 23705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "475e2aa820ea447eafea8e36a8f540b3"
format_stamp: "Formatted at 2026-09-29 06:38:41 on dist-test-slave-ltw5"
server_key: "c015e4788ba6d18a15c10f2d71495fec"
server_key_iv: "e8b8c514c7c36d917680a77a85c54e1b"
server_key_version: "encryptionkey@0"
I20260929 06:38:41.370152 23705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "475e2aa820ea447eafea8e36a8f540b3"
format_stamp: "Formatted at 2026-09-29 06:38:41 on dist-test-slave-ltw5"
server_key: "c015e4788ba6d18a15c10f2d71495fec"
server_key_iv: "e8b8c514c7c36d917680a77a85c54e1b"
server_key_version: "encryptionkey@0"
I20260929 06:38:41.371454 23705 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:41.372151 23720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:41.372327 23705 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:41.372421 23705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "475e2aa820ea447eafea8e36a8f540b3"
format_stamp: "Formatted at 2026-09-29 06:38:41 on dist-test-slave-ltw5"
server_key: "c015e4788ba6d18a15c10f2d71495fec"
server_key_iv: "e8b8c514c7c36d917680a77a85c54e1b"
server_key_version: "encryptionkey@0"
I20260929 06:38:41.372498 23705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:41.381050 23705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:41.382827 23705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:41.382985 23705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:41.383458 23705 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:41.383523 23705 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:41.383559 23705 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:41.383587 23705 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:41.390142 23705 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:39271
I20260929 06:38:41.390237 23835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:39271 every 8 connection(s)
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663921, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
I20260929 06:38:41.390494 23705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:38:41.393288 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.383915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:49289 (local address 127.15.157.190:45439)
0929 06:38:41.383988 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.383990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.384169 (+ 179us) server_negotiation.cc:407] Connection header received
0929 06:38:41.384624 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.384625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.384637 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.384716 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:41.385525 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.386372 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.387946 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.388294 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.388371 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.390983 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:41.390984 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:41.390984 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:41.390991 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:41.392170 (+ 1179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.392524 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.392525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.392525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.392573 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.392786 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.392787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.392787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.392883 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:41.392933 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.393151 (+ 218us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.393226 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:38:41.393461 23729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.383893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45439 (local address 127.15.157.130:49289)
0929 06:38:41.384036 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.384075 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.384528 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.384766 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.384769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.385131 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:41.385415 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.385422 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.386481 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.386482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.387852 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.387855 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.388404 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.388405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.388525 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.389097 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:41.389108 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:41.390888 (+ 1780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:41.392250 (+ 1362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:41.392256 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:41.392258 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:41.392463 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:41.392629 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:41.392629 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:41.392630 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:41.392732 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:41.392937 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:41.392941 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:41.393048 (+ 107us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.393126 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.393239 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":80,"threads_started":1}
I20260929 06:38:41.393967 23836 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45439
I20260929 06:38:41.394089 23836 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:41.394264 23836 heartbeater.cc:511] Master 127.15.157.190:45439 requested a full tablet report, sending...
I20260929 06:38:41.394745 23492 ts_manager.cc:194] Registered new tserver with Master: 475e2aa820ea447eafea8e36a8f540b3 (127.15.157.130:39271)
I20260929 06:38:41.395279 23492 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:49289
I20260929 06:38:41.399622 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 23705
I20260929 06:38:41.399783 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:38:41.399998 15990 external_mini_cluster.cc:1428] Setting key ea3fce52a18cfba03feb25075b6375c6
I20260929 06:38:41.400840 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.395065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:39473 (local address 127.15.157.190:45439)
0929 06:38:41.395111 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.395113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.395158 (+ 45us) server_negotiation.cc:407] Connection header received
0929 06:38:41.395221 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.395221 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.395229 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.395268 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:41.395656 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.396115 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.396814 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.397032 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.397105 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.397983 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:41.397984 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:41.397985 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:41.397991 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:41.399373 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.399964 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.399965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.399965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.400013 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.400239 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.400240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.400240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.400433 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:41.400512 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.400669 (+ 157us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.400750 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 06:38:41.400864 23842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.394978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45439 (local address 127.15.157.130:39473)
0929 06:38:41.395103 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.395114 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.395170 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.395284 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.395284 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.395485 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:41.395570 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.395572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.396205 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.396207 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.396720 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.396721 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.397103 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.397104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.397166 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.397625 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:41.397629 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:41.397895 (+ 266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:41.399470 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:41.399471 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:41.399472 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:41.399646 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:41.400094 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:41.400095 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:41.400095 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:41.400160 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:41.400504 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:41.400505 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:41.400556 (+ 51us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.400646 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.400761 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":76,"threads_started":1}
WARNING: no policy specified for oryx/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.131.keytab.
Entry for principal oryx/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.131.keytab.
I20260929 06:38:41.426055 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45439
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.131.keytab
--principal=oryx/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:46377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:41.506289 23845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:41.506502 23845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:41.506527 23845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:41.507682 23845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:41.507723 23845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:41.507743 23845 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:38:41.507802 23845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:41.509269 23845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:46377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.131.keytab
--principal=oryx/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.157.190:45439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:41.509507 23845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:41.509737 23845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:41.514459 23853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:41.514475 23851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:41.514493 23845 server_base.cc:1034] running on GCE node
W20260929 06:38:41.514451 23850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:41.514840 23845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:41.515069 23845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:41.516232 23845 hybrid_clock.cc:648] HybridClock initialized: now 1790663921516229 us; error 35 us; skew 500 ppm
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663921, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:41.518677 23845 init.cc:377] Logged in from keytab as oryx/127.15.157.131@KRBTEST.COM (short username oryx)
I20260929 06:38:41.519093 23845 webserver.cc:460] Webserver started at http://127.15.157.131:39059/ using document root <none> and password file <none>
I20260929 06:38:41.519331 23845 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:41.519399 23845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:41.519549 23845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:41.520577 23845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "c0f22a1a885b477494ee12d178710197"
format_stamp: "Formatted at 2026-09-29 06:38:41 on dist-test-slave-ltw5"
server_key: "c1c7046d1d02b12a31dbcfd7bf10afe5"
server_key_iv: "f4cc566011c0a4e146282c2f7b15c67f"
server_key_version: "encryptionkey@0"
I20260929 06:38:41.520928 23845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "c0f22a1a885b477494ee12d178710197"
format_stamp: "Formatted at 2026-09-29 06:38:41 on dist-test-slave-ltw5"
server_key: "c1c7046d1d02b12a31dbcfd7bf10afe5"
server_key_iv: "f4cc566011c0a4e146282c2f7b15c67f"
server_key_version: "encryptionkey@0"
I20260929 06:38:41.522269 23845 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:38:41.522922 23860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:41.523088 23845 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:41.523175 23845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "c0f22a1a885b477494ee12d178710197"
format_stamp: "Formatted at 2026-09-29 06:38:41 on dist-test-slave-ltw5"
server_key: "c1c7046d1d02b12a31dbcfd7bf10afe5"
server_key_iv: "f4cc566011c0a4e146282c2f7b15c67f"
server_key_version: "encryptionkey@0"
I20260929 06:38:41.523267 23845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:41.543618 23845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:41.545943 23845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:41.546129 23845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:41.546679 23845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:41.546734 23845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:41.546773 23845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:41.546797 23845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663921, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
I20260929 06:38:41.554176 23845 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:39327
I20260929 06:38:41.554237 23975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:39327 every 8 connection(s)
I20260929 06:38:41.554579 23845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:38:41.556507 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.547060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:32837 (local address 127.15.157.190:45439)
0929 06:38:41.547126 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.547128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.547373 (+ 245us) server_negotiation.cc:407] Connection header received
0929 06:38:41.548066 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.548067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.548077 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.548157 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:41.549060 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.549560 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.550854 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.551048 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.551132 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.553825 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:41.553826 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:41.553826 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:41.553832 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:41.555389 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.555787 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.555788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.555788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.555837 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.556009 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.556009 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.556010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.556105 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:41.556152 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.556387 (+ 235us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.556444 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 06:38:41.556727 23869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.547054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45439 (local address 127.15.157.131:32837)
0929 06:38:41.547203 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.547255 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.547957 (+ 702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.548252 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.548256 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.548656 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:41.548962 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.548969 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.549660 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.549662 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.550765 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.550768 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.551155 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.551156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.551274 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.551811 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:41.551819 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:41.553732 (+ 1913us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:41.555481 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:41.555486 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:41.555488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:41.555720 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:41.555879 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:41.555880 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:41.555880 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:41.555960 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:41.556160 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:41.556164 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:41.556282 (+ 118us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.556362 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.556472 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":74,"threads_started":1}
I20260929 06:38:41.557257 23976 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45439
I20260929 06:38:41.557346 23976 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:41.557520 23976 heartbeater.cc:511] Master 127.15.157.190:45439 requested a full tablet report, sending...
I20260929 06:38:41.557942 23493 ts_manager.cc:194] Registered new tserver with Master: c0f22a1a885b477494ee12d178710197 (127.15.157.131:39327)
I20260929 06:38:41.558473 23493 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:32837
I20260929 06:38:41.560838 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 23845
I20260929 06:38:41.560943 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:38:41.561125 15990 external_mini_cluster.cc:1428] Setting key ebed2e4737289b001bf1e5fd953a85cf
I20260929 06:38:41.562083 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:38:41.563894 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.558294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:38073 (local address 127.15.157.190:45439)
0929 06:38:41.558329 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.558331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.558495 (+ 164us) server_negotiation.cc:407] Connection header received
0929 06:38:41.558586 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.558587 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.558597 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.558656 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:41.559005 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.559448 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.560113 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.560288 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.560340 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.561294 (+ 954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:41.561295 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:41.561295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:41.561303 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:41.562804 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.563146 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.563147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.563148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.563199 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.563403 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.563404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.563405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.563512 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:41.563584 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.563731 (+ 147us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.563803 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 06:38:41.563907 23982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.558249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45439 (local address 127.15.157.131:38073)
0929 06:38:41.558431 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.558440 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.558510 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.558662 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.558663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.558863 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:41.558927 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.558929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.559540 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.559540 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.560042 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.560044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.560350 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.560351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.560395 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.560759 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:41.560765 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:41.561162 (+ 397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:41.562895 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:41.562896 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:41.562897 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:41.563064 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:41.563275 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:41.563276 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:41.563276 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:41.563331 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:41.563577 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:41.563577 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:41.563621 (+ 44us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.563707 (+ 86us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.563805 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":116,"threads_started":1}
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663921, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
W20260929 06:38:41.583199 23543 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:41.578065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56514 (local address 127.15.157.190:45439)
0929 06:38:41.578128 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.578130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.578141 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:38:41.578213 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.578214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.578222 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.578271 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:41.578789 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.579294 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.580012 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.580188 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.580248 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.583106 (+ 2858us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56514: BlockingRecv error: recv got EOF from 127.0.0.1:56514 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663921, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
I20260929 06:38:41.590385 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.583916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56530 (local address 127.15.157.190:45439)
0929 06:38:41.583953 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.583955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.584010 (+ 55us) server_negotiation.cc:407] Connection header received
0929 06:38:41.584068 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.584069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.584076 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.584125 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:41.584536 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.584994 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.585618 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.585789 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.585837 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.587886 (+ 2049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:41.587887 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:41.587888 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:41.587895 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:41.589227 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.589581 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.589582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.589583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.589638 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.589845 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.589846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.589846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.589952 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:41.590112 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.590209 (+ 97us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.590283 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:38:41.591800 23493 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56530:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:38:41.593361 23493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:41.600140 23999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.595704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:39627 (local address 127.0.0.1:58862)
0929 06:38:41.595914 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.596033 (+ 119us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.596100 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.596454 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.596458 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.596461 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:41.596535 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.596536 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.597851 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.597852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.598929 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.598932 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.599805 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.599806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.599881 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.599895 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.599977 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.600040 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":107,"thread_start_us":92,"threads_started":1}
I20260929 06:38:41.600145 24000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.595822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58862 (local address 127.15.157.129:39627)
0929 06:38:41.596239 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.596243 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.596250 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:41.596285 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.596286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.596300 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.596377 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:41.596627 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.597745 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.599015 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.599716 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.599815 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.599873 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.599994 (+ 121us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.600036 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":70,"threads_started":1}
I20260929 06:38:41.600364 24002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.595744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:39327 (local address 127.0.0.1:58756)
0929 06:38:41.596062 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.596074 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.596127 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.596699 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.596699 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.596702 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:41.596752 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.596754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.597745 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.597746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.599170 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.599173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.600103 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.600104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.600166 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.600171 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.600232 (+ 61us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.600278 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":59,"thread_start_us":83,"threads_started":1}
I20260929 06:38:41.600634 24001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.595852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58756 (local address 127.15.157.131:39327)
0929 06:38:41.596495 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.596500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.596509 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:41.596544 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.596546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.596561 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.596634 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:41.596833 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.597632 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.599249 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.599940 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.600021 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.600067 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.600508 (+ 441us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.600548 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":83,"threads_started":1}
I20260929 06:38:41.600760 23998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.595943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:39271 (local address 127.0.0.1:44244)
0929 06:38:41.596064 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.596074 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.596127 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.596493 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.596493 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.596495 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:41.596534 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.596536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.597845 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.597845 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.599362 (+ 1517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.599364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.600540 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.600541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.600607 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.600611 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.600658 (+ 47us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.600692 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":63,"thread_start_us":73,"threads_started":1}
I20260929 06:38:41.601017 24003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.596012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44244 (local address 127.15.157.130:39271)
0929 06:38:41.596195 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.596201 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.596226 (+ 25us) server_negotiation.cc:407] Connection header received
0929 06:38:41.596268 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.596270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.596287 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.596375 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:41.596627 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.597773 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.599444 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.600069 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.600148 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.600851 (+ 703us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.600879 (+ 28us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.600918 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":82,"threads_started":1}
I20260929 06:38:41.600960 23630 tablet_service.cc:1467] Processing CreateTablet for tablet 301e5ae633824c5b9af58f25f5dcab81 (DEFAULT_TABLE table=test-table [id=57c6315f653a42cf88faa7ac424544e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:41.601331 23630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 301e5ae633824c5b9af58f25f5dcab81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:41.601227 23910 tablet_service.cc:1467] Processing CreateTablet for tablet 301e5ae633824c5b9af58f25f5dcab81 (DEFAULT_TABLE table=test-table [id=57c6315f653a42cf88faa7ac424544e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:41.601516 23910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 301e5ae633824c5b9af58f25f5dcab81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:41.601644 23770 tablet_service.cc:1467] Processing CreateTablet for tablet 301e5ae633824c5b9af58f25f5dcab81 (DEFAULT_TABLE table=test-table [id=57c6315f653a42cf88faa7ac424544e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:41.601939 23770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 301e5ae633824c5b9af58f25f5dcab81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:41.604152 24004 tablet_bootstrap.cc:492] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197: Bootstrap starting.
I20260929 06:38:41.604709 24004 tablet_bootstrap.cc:654] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:41.604923 24004 log.cc:824] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:41.605682 24004 tablet_bootstrap.cc:492] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197: No bootstrap required, opened a new log
I20260929 06:38:41.605744 24004 ts_tablet_manager.cc:1397] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:38:41.607192 24004 raft_consensus.cc:348] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.607322 24004 raft_consensus.cc:374] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:41.607344 24004 raft_consensus.cc:729] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f22a1a885b477494ee12d178710197, State: Initialized, Role: FOLLOWER
I20260929 06:38:41.607424 24004 consensus_queue.cc:260] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.607602 24004 ts_tablet_manager.cc:1428] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:38:41.607733 23976 heartbeater.cc:503] Master 127.15.157.190:45439 was elected leader, sending a full tablet report...
I20260929 06:38:41.607793 24006 tablet_bootstrap.cc:492] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903: Bootstrap starting.
I20260929 06:38:41.608399 24006 tablet_bootstrap.cc:654] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:41.608737 24006 log.cc:824] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:41.609001 24007 tablet_bootstrap.cc:492] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3: Bootstrap starting.
I20260929 06:38:41.609372 24006 tablet_bootstrap.cc:492] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903: No bootstrap required, opened a new log
I20260929 06:38:41.609427 24006 ts_tablet_manager.cc:1397] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:38:41.609561 24007 tablet_bootstrap.cc:654] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:41.609839 24007 log.cc:824] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:41.610491 24007 tablet_bootstrap.cc:492] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3: No bootstrap required, opened a new log
I20260929 06:38:41.610570 24007 ts_tablet_manager.cc:1397] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 06:38:41.611016 24006 raft_consensus.cc:348] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.611141 24006 raft_consensus.cc:374] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:41.611162 24006 raft_consensus.cc:729] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1c36a949b84bb69c391392f763e903, State: Initialized, Role: FOLLOWER
I20260929 06:38:41.611285 24006 consensus_queue.cc:260] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.611531 24006 ts_tablet_manager.cc:1428] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:38:41.611588 23696 heartbeater.cc:503] Master 127.15.157.190:45439 was elected leader, sending a full tablet report...
I20260929 06:38:41.612663 24007 raft_consensus.cc:348] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.612782 24007 raft_consensus.cc:374] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:41.612802 24007 raft_consensus.cc:729] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475e2aa820ea447eafea8e36a8f540b3, State: Initialized, Role: FOLLOWER
I20260929 06:38:41.612908 24007 consensus_queue.cc:260] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.613118 24007 ts_tablet_manager.cc:1428] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 06:38:41.613199 23836 heartbeater.cc:503] Master 127.15.157.190:45439 was elected leader, sending a full tablet report...
I20260929 06:38:41.613783 24008 raft_consensus.cc:482] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:41.613869 24008 raft_consensus.cc:504] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.614177 24008 leader_election.cc:288] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1c36a949b84bb69c391392f763e903 (127.15.157.129:39627), 475e2aa820ea447eafea8e36a8f540b3 (127.15.157.130:39271)
I20260929 06:38:41.617944 24000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.614521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:33151 (local address 127.15.157.129:39627)
0929 06:38:41.614563 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.614564 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.614572 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:41.614596 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.614597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.614605 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.614666 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:41.614819 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.615599 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.617054 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.617596 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.617663 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.617671 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.617846 (+ 175us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.617883 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:38:41.617944 24003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.614489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:36015 (local address 127.15.157.130:39271)
0929 06:38:41.614531 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.614534 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.614584 (+ 50us) server_negotiation.cc:407] Connection header received
0929 06:38:41.614649 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.614650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.614658 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.614729 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:41.614863 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.615574 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.617054 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.617585 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.617663 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.617671 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.617846 (+ 175us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.617883 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:38:41.617969 23869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.614333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:39627 (local address 127.15.157.131:33151)
0929 06:38:41.614375 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.614387 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.614437 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.614680 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.614681 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.614682 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:41.614744 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.614745 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.615670 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.615671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.616970 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.616973 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.617672 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.617673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.617769 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.617772 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.617828 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.617870 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22,"mutex_wait_us":65}
I20260929 06:38:41.617964 24013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.614403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:39271 (local address 127.15.157.131:36015)
0929 06:38:41.614535 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.614545 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.614593 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.614733 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.614734 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.614735 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:41.614799 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.614801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.615670 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.615671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.616971 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.616973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.617672 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.617673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.617769 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.617772 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.617828 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.617870 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":46,"thread_start_us":90,"threads_started":1}
I20260929 06:38:41.618326 23650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "301e5ae633824c5b9af58f25f5dcab81" candidate_uuid: "c0f22a1a885b477494ee12d178710197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1c36a949b84bb69c391392f763e903" is_pre_election: true
I20260929 06:38:41.618352 23790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "301e5ae633824c5b9af58f25f5dcab81" candidate_uuid: "c0f22a1a885b477494ee12d178710197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475e2aa820ea447eafea8e36a8f540b3" is_pre_election: true
I20260929 06:38:41.618440 23650 raft_consensus.cc:2454] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f22a1a885b477494ee12d178710197 in term 0.
I20260929 06:38:41.618438 23790 raft_consensus.cc:2454] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f22a1a885b477494ee12d178710197 in term 0.
I20260929 06:38:41.618640 23864 leader_election.cc:302] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475e2aa820ea447eafea8e36a8f540b3, c0f22a1a885b477494ee12d178710197; no voters:
I20260929 06:38:41.618762 24008 raft_consensus.cc:2781] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:41.618815 24008 raft_consensus.cc:482] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:41.618839 24008 raft_consensus.cc:3037] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:41.619647 24008 raft_consensus.cc:504] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.619776 24008 leader_election.cc:288] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [CANDIDATE]: Term 1 election: Requested vote from peers cc1c36a949b84bb69c391392f763e903 (127.15.157.129:39627), 475e2aa820ea447eafea8e36a8f540b3 (127.15.157.130:39271)
I20260929 06:38:41.619901 23650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "301e5ae633824c5b9af58f25f5dcab81" candidate_uuid: "c0f22a1a885b477494ee12d178710197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1c36a949b84bb69c391392f763e903"
I20260929 06:38:41.619935 23790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "301e5ae633824c5b9af58f25f5dcab81" candidate_uuid: "c0f22a1a885b477494ee12d178710197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475e2aa820ea447eafea8e36a8f540b3"
I20260929 06:38:41.619988 23790 raft_consensus.cc:3037] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:41.619983 23650 raft_consensus.cc:3037] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:41.620790 23790 raft_consensus.cc:2454] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f22a1a885b477494ee12d178710197 in term 1.
I20260929 06:38:41.620790 23650 raft_consensus.cc:2454] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f22a1a885b477494ee12d178710197 in term 1.
I20260929 06:38:41.620942 23864 leader_election.cc:302] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475e2aa820ea447eafea8e36a8f540b3, c0f22a1a885b477494ee12d178710197; no voters:
I20260929 06:38:41.621042 24008 raft_consensus.cc:2781] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:41.621167 24008 raft_consensus.cc:686] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [term 1 LEADER]: Becoming Leader. State: Replica: c0f22a1a885b477494ee12d178710197, State: Running, Role: LEADER
I20260929 06:38:41.621237 24008 consensus_queue.cc:237] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.622073 23492 catalog_manager.cc:5495] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f22a1a885b477494ee12d178710197 (127.15.157.131). New cstate: current_term: 1 leader_uuid: "c0f22a1a885b477494ee12d178710197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } health_report { overall_health: UNKNOWN } } }
I20260929 06:38:41.632074 24001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.629621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58768 (local address 127.15.157.131:39327)
0929 06:38:41.629679 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.629681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.629692 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:38:41.629770 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.629771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.629788 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.629860 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:41.630009 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.630501 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.631275 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.631482 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.631557 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.631732 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:41.631839 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:41.631920 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.631968 (+ 48us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.631989 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 06:38:41.633776 23650 raft_consensus.cc:1261] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Refusing update from remote peer c0f22a1a885b477494ee12d178710197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:41.633926 23790 raft_consensus.cc:1261] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Refusing update from remote peer c0f22a1a885b477494ee12d178710197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:41.634115 24014 consensus_queue.cc:1035] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:41.634234 24008 consensus_queue.cc:1035] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:41.636435 24017 mvcc.cc:205] Tried to move back new op lower bound from 7334559423009468416 to 7334559422961201152. Current Snapshot: MvccSnapshot[applied={T|T < 7334559423009468416}]
I20260929 06:38:41.636469 24018 mvcc.cc:205] Tried to move back new op lower bound from 7334559423009468416 to 7334559422961201152. Current Snapshot: MvccSnapshot[applied={T|T < 7334559423009468416}]
I20260929 06:38:41.638573 23492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:41.638675 23492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:41.639426 23492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804: Sending DeleteTablet for 3 replicas of tablet 301e5ae633824c5b9af58f25f5dcab81
I20260929 06:38:41.639746 23910 tablet_service.cc:1514] Processing DeleteTablet for tablet 301e5ae633824c5b9af58f25f5dcab81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:41 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:58756
I20260929 06:38:41.639840 23770 tablet_service.cc:1514] Processing DeleteTablet for tablet 301e5ae633824c5b9af58f25f5dcab81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:41 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:44244
I20260929 06:38:41.639842 23630 tablet_service.cc:1514] Processing DeleteTablet for tablet 301e5ae633824c5b9af58f25f5dcab81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:41 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:58862
I20260929 06:38:41.640045 24027 tablet_replica.cc:330] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197: stopping tablet replica
I20260929 06:38:41.640048 24029 tablet_replica.cc:330] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903: stopping tablet replica
I20260929 06:38:41.640138 24029 raft_consensus.cc:2229] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:41.640164 24027 raft_consensus.cc:2229] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:38:41.640262 24029 raft_consensus.cc:2258] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:41.640237 23492 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56530:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:38:41.640379 23492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:41.640559 24027 raft_consensus.cc:2258] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:41.640725 24029 ts_tablet_manager.cc:1905] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:41.641534 23630 tablet_service.cc:1467] Processing CreateTablet for tablet 0ce45e48339e46f09020aa5d290c82e0 (DEFAULT_TABLE table=test-table [id=d66eb18f0c5142989ee2633db0130600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:41.641563 23770 tablet_service.cc:1467] Processing CreateTablet for tablet 0ce45e48339e46f09020aa5d290c82e0 (DEFAULT_TABLE table=test-table [id=d66eb18f0c5142989ee2633db0130600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:41.641655 23630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ce45e48339e46f09020aa5d290c82e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:41.641669 23770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ce45e48339e46f09020aa5d290c82e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:41.642982 24006 tablet_bootstrap.cc:492] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903: Bootstrap starting.
I20260929 06:38:41.643390 24006 tablet_bootstrap.cc:654] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:41.643406 24007 tablet_bootstrap.cc:492] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3: Bootstrap starting.
I20260929 06:38:41.643733 24029 ts_tablet_manager.cc:1918] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:41.643802 24029 log.cc:1196] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/wal/wals/301e5ae633824c5b9af58f25f5dcab81
I20260929 06:38:41.643808 24007 tablet_bootstrap.cc:654] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:41.643832 23910 tablet_service.cc:1467] Processing CreateTablet for tablet 0ce45e48339e46f09020aa5d290c82e0 (DEFAULT_TABLE table=test-table [id=d66eb18f0c5142989ee2633db0130600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:41.643931 23910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ce45e48339e46f09020aa5d290c82e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:41.644042 24029 ts_tablet_manager.cc:1939] T 301e5ae633824c5b9af58f25f5dcab81 P cc1c36a949b84bb69c391392f763e903: Deleting consensus metadata
I20260929 06:38:41.644403 23480 catalog_manager.cc:4841] TS cc1c36a949b84bb69c391392f763e903 (127.15.157.129:39627): tablet 301e5ae633824c5b9af58f25f5dcab81 (table test-table [id=57c6315f653a42cf88faa7ac424544e8]) successfully deleted
I20260929 06:38:41.644609 24007 tablet_bootstrap.cc:492] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3: No bootstrap required, opened a new log
I20260929 06:38:41.644651 24007 ts_tablet_manager.cc:1397] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:41.644796 24007 raft_consensus.cc:348] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.644865 24007 raft_consensus.cc:374] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:41.644887 24007 raft_consensus.cc:729] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475e2aa820ea447eafea8e36a8f540b3, State: Initialized, Role: FOLLOWER
I20260929 06:38:41.644937 24007 consensus_queue.cc:260] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.645023 24007 ts_tablet_manager.cc:1428] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:41.645133 24004 tablet_bootstrap.cc:492] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197: Bootstrap starting.
I20260929 06:38:41.645378 24006 tablet_bootstrap.cc:492] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903: No bootstrap required, opened a new log
I20260929 06:38:41.645426 24006 ts_tablet_manager.cc:1397] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:38:41.645541 24004 tablet_bootstrap.cc:654] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:41.645587 24006 raft_consensus.cc:348] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.645664 24006 raft_consensus.cc:374] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:41.645691 24006 raft_consensus.cc:729] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1c36a949b84bb69c391392f763e903, State: Initialized, Role: FOLLOWER
I20260929 06:38:41.645733 24006 consensus_queue.cc:260] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.645814 24006 ts_tablet_manager.cc:1428] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:41.646059 24027 ts_tablet_manager.cc:1905] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:41.647291 24028 tablet_replica.cc:330] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3: stopping tablet replica
I20260929 06:38:41.647377 24028 raft_consensus.cc:2229] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:41.647533 24028 raft_consensus.cc:2258] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:41.647591 24027 ts_tablet_manager.cc:1918] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:41.647662 24027 log.cc:1196] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/301e5ae633824c5b9af58f25f5dcab81
I20260929 06:38:41.647907 24027 ts_tablet_manager.cc:1939] T 301e5ae633824c5b9af58f25f5dcab81 P c0f22a1a885b477494ee12d178710197: Deleting consensus metadata
I20260929 06:38:41.647966 24028 ts_tablet_manager.cc:1905] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:41.648311 23478 catalog_manager.cc:4841] TS c0f22a1a885b477494ee12d178710197 (127.15.157.131:39327): tablet 301e5ae633824c5b9af58f25f5dcab81 (table test-table [id=57c6315f653a42cf88faa7ac424544e8]) successfully deleted
I20260929 06:38:41.649288 24028 ts_tablet_manager.cc:1918] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:41.649370 24028 log.cc:1196] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/301e5ae633824c5b9af58f25f5dcab81
I20260929 06:38:41.649588 24028 ts_tablet_manager.cc:1939] T 301e5ae633824c5b9af58f25f5dcab81 P 475e2aa820ea447eafea8e36a8f540b3: Deleting consensus metadata
I20260929 06:38:41.649968 23480 catalog_manager.cc:4841] TS 475e2aa820ea447eafea8e36a8f540b3 (127.15.157.130:39271): tablet 301e5ae633824c5b9af58f25f5dcab81 (table test-table [id=57c6315f653a42cf88faa7ac424544e8]) successfully deleted
I20260929 06:38:41.654444 24004 tablet_bootstrap.cc:492] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197: No bootstrap required, opened a new log
I20260929 06:38:41.654501 24004 ts_tablet_manager.cc:1397] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260929 06:38:41.654647 24004 raft_consensus.cc:348] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.654721 24004 raft_consensus.cc:374] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:41.654740 24004 raft_consensus.cc:729] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f22a1a885b477494ee12d178710197, State: Initialized, Role: FOLLOWER
I20260929 06:38:41.654781 24004 consensus_queue.cc:260] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.654868 24004 ts_tablet_manager.cc:1428] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:41.736500 24011 raft_consensus.cc:482] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:41.736728 24011 raft_consensus.cc:504] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.737116 24011 leader_election.cc:288] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 475e2aa820ea447eafea8e36a8f540b3 (127.15.157.130:39271), c0f22a1a885b477494ee12d178710197 (127.15.157.131:39327)
W20260929 06:38:41.739766 23697 tablet.cc:2369] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:38:41.740617 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.737301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:39327 (local address 127.15.157.129:44883)
0929 06:38:41.737355 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.737367 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.737415 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.737710 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.737711 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.737713 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:41.737780 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.737782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.738584 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.738585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.739636 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.739638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.740356 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.740357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.740434 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.740438 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.740495 (+ 57us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.740531 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":57}
I20260929 06:38:41.740626 24001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.737489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:44883 (local address 127.15.157.131:39327)
0929 06:38:41.737533 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.737535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.737544 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:41.737571 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.737572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.737583 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.737662 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:41.737864 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.738494 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.739747 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.740271 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.740343 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.740350 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.740511 (+ 161us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.740545 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:38:41.740949 24003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.737491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:56359 (local address 127.15.157.130:39271)
0929 06:38:41.737533 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.737535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.737543 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:41.737607 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.737608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.737617 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.737704 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:41.737915 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.738668 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.740022 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.740552 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.740616 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.740624 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.740841 (+ 217us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.740887 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:38:41.740945 23930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ce45e48339e46f09020aa5d290c82e0" candidate_uuid: "cc1c36a949b84bb69c391392f763e903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f22a1a885b477494ee12d178710197" is_pre_election: true
I20260929 06:38:41.741058 23930 raft_consensus.cc:2454] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1c36a949b84bb69c391392f763e903 in term 0.
I20260929 06:38:41.741140 24033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.737329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:39271 (local address 127.15.157.129:56359)
0929 06:38:41.737504 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.737512 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.737552 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.737743 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.737744 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.737745 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:41.737846 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.737847 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.738771 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.738772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.739903 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.739905 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.740656 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.740657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.740745 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.740750 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.741028 (+ 278us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.741066 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":74,"threads_started":1}
I20260929 06:38:41.741259 23582 leader_election.cc:302] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f22a1a885b477494ee12d178710197, cc1c36a949b84bb69c391392f763e903; no voters:
I20260929 06:38:41.741362 24011 raft_consensus.cc:2781] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:41.741398 24011 raft_consensus.cc:482] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:41.741374 23790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ce45e48339e46f09020aa5d290c82e0" candidate_uuid: "cc1c36a949b84bb69c391392f763e903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475e2aa820ea447eafea8e36a8f540b3" is_pre_election: true
I20260929 06:38:41.741425 24011 raft_consensus.cc:3037] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:41.741448 23790 raft_consensus.cc:2454] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1c36a949b84bb69c391392f763e903 in term 0.
I20260929 06:38:41.742187 24011 raft_consensus.cc:504] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.742326 24011 leader_election.cc:288] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [CANDIDATE]: Term 1 election: Requested vote from peers 475e2aa820ea447eafea8e36a8f540b3 (127.15.157.130:39271), c0f22a1a885b477494ee12d178710197 (127.15.157.131:39327)
I20260929 06:38:41.742449 23790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ce45e48339e46f09020aa5d290c82e0" candidate_uuid: "cc1c36a949b84bb69c391392f763e903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475e2aa820ea447eafea8e36a8f540b3"
I20260929 06:38:41.742525 23790 raft_consensus.cc:3037] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:41.743065 23790 raft_consensus.cc:2454] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1c36a949b84bb69c391392f763e903 in term 1.
I20260929 06:38:41.743193 23930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ce45e48339e46f09020aa5d290c82e0" candidate_uuid: "cc1c36a949b84bb69c391392f763e903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f22a1a885b477494ee12d178710197"
I20260929 06:38:41.743279 23930 raft_consensus.cc:3037] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:41.743269 23584 leader_election.cc:302] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475e2aa820ea447eafea8e36a8f540b3, cc1c36a949b84bb69c391392f763e903; no voters:
I20260929 06:38:41.743875 23930 raft_consensus.cc:2454] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1c36a949b84bb69c391392f763e903 in term 1.
I20260929 06:38:41.743975 24011 raft_consensus.cc:2781] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:41.744087 24011 raft_consensus.cc:686] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [term 1 LEADER]: Becoming Leader. State: Replica: cc1c36a949b84bb69c391392f763e903, State: Running, Role: LEADER
I20260929 06:38:41.744158 24011 consensus_queue.cc:237] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.744815 23492 catalog_manager.cc:5495] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc1c36a949b84bb69c391392f763e903 (127.15.157.129). New cstate: current_term: 1 leader_uuid: "cc1c36a949b84bb69c391392f763e903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } health_report { overall_health: UNKNOWN } } }
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663920, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.190@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
I20260929 06:38:41.793053 24041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.786733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45439 (local address 127.0.0.1:56542)
0929 06:38:41.786918 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.786928 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.786995 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.787150 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.787151 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.787454 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:41.787501 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.787503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.788192 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.788193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.788708 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.788709 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.789033 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.789034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.789072 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.789552 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:41.789556 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:41.790852 (+ 1296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:41.792163 (+ 1311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:41.792169 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:41.792171 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:41.792357 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:41.792526 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:41.792527 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:41.792527 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:41.792580 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:41.792785 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:41.792790 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:41.792826 (+ 36us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.792876 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.792958 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":74,"threads_started":1}
I20260929 06:38:41.793119 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.786855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56542 (local address 127.15.157.190:45439)
0929 06:38:41.786948 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.786950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.786978 (+ 28us) server_negotiation.cc:407] Connection header received
0929 06:38:41.787059 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.787059 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.787069 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.787136 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:41.787599 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.788095 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.788789 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.788966 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.789023 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.790927 (+ 1904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:41.790928 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:41.790928 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:41.790933 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:41.792095 (+ 1162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.792422 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.792423 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.792423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.792470 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.792631 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.792631 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.792631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.792733 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:41.792781 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.792915 (+ 134us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.793002 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":67}
I20260929 06:38:41.795038 23492 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:56542:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260929 06:38:41.795253 23492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:41.796692 23630 tablet_service.cc:1467] Processing CreateTablet for tablet 12eb28db92e4423c8fcbe597f153b641 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=597468ca7c9a4e9fb8454d9cfb6e73ed]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:38:41.796702 23770 tablet_service.cc:1467] Processing CreateTablet for tablet 12eb28db92e4423c8fcbe597f153b641 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=597468ca7c9a4e9fb8454d9cfb6e73ed]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:38:41.796846 23630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12eb28db92e4423c8fcbe597f153b641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:41.796859 23770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12eb28db92e4423c8fcbe597f153b641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:41.798069 24006 tablet_bootstrap.cc:492] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903: Bootstrap starting.
I20260929 06:38:41.798345 24007 tablet_bootstrap.cc:492] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3: Bootstrap starting.
I20260929 06:38:41.798441 23910 tablet_service.cc:1467] Processing CreateTablet for tablet 12eb28db92e4423c8fcbe597f153b641 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=597468ca7c9a4e9fb8454d9cfb6e73ed]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:38:41.798511 24006 tablet_bootstrap.cc:654] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:41.798583 23910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12eb28db92e4423c8fcbe597f153b641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:41.798759 24007 tablet_bootstrap.cc:654] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:41.799352 24007 tablet_bootstrap.cc:492] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3: No bootstrap required, opened a new log
I20260929 06:38:41.799346 24006 tablet_bootstrap.cc:492] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903: No bootstrap required, opened a new log
I20260929 06:38:41.799399 24006 ts_tablet_manager.cc:1397] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:41.799399 24007 ts_tablet_manager.cc:1397] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:41.799546 24007 raft_consensus.cc:348] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.799546 24006 raft_consensus.cc:348] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.799618 24006 raft_consensus.cc:374] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:41.799618 24007 raft_consensus.cc:374] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:41.799640 24006 raft_consensus.cc:729] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1c36a949b84bb69c391392f763e903, State: Initialized, Role: FOLLOWER
I20260929 06:38:41.799640 24007 raft_consensus.cc:729] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475e2aa820ea447eafea8e36a8f540b3, State: Initialized, Role: FOLLOWER
I20260929 06:38:41.799683 24007 consensus_queue.cc:260] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.799693 24006 consensus_queue.cc:260] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.799774 24007 ts_tablet_manager.cc:1428] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:41.799774 24006 ts_tablet_manager.cc:1428] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:41.799918 24012 tablet_replica.cc:439] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } }
I20260929 06:38:41.800031 24012 tablet_replica.cc:442] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:41.800050 24011 tablet_replica.cc:439] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } }
I20260929 06:38:41.800146 24011 tablet_replica.cc:442] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:41.800246 24004 tablet_bootstrap.cc:492] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197: Bootstrap starting.
I20260929 06:38:41.800568 24004 tablet_bootstrap.cc:654] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:41.801064 24004 tablet_bootstrap.cc:492] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197: No bootstrap required, opened a new log
I20260929 06:38:41.801102 24004 ts_tablet_manager.cc:1397] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:41.801180 24004 raft_consensus.cc:348] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.801231 24004 raft_consensus.cc:374] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:41.801244 24004 raft_consensus.cc:729] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f22a1a885b477494ee12d178710197, State: Initialized, Role: FOLLOWER
I20260929 06:38:41.801304 24004 consensus_queue.cc:260] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.801419 24004 ts_tablet_manager.cc:1428] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:41.801446 24022 tablet_replica.cc:439] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } }
I20260929 06:38:41.801520 24022 tablet_replica.cc:442] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:41.803085 24012 raft_consensus.cc:482] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:41.803133 24012 raft_consensus.cc:504] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.803355 24012 leader_election.cc:288] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1c36a949b84bb69c391392f763e903 (127.15.157.129:39627), c0f22a1a885b477494ee12d178710197 (127.15.157.131:39327)
W20260929 06:38:41.805141 23977 tablet.cc:2369] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:38:41.805996 24000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.803547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:58739 (local address 127.15.157.129:39627)
0929 06:38:41.803590 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.803592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.803601 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:41.803635 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.803636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.803644 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.803709 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:41.803832 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.804310 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.805282 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.805697 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.805769 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.805780 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.805926 (+ 146us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.805952 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:38:41.806054 23729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.803491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:39627 (local address 127.15.157.130:58739)
0929 06:38:41.803541 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.803551 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.803591 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.803709 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.803709 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.803711 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:41.803761 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.803762 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.804393 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.804394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.805145 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.805148 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.805775 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.805776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.805855 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.805859 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.805922 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.805959 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260929 06:38:41.806255 23650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12eb28db92e4423c8fcbe597f153b641" candidate_uuid: "475e2aa820ea447eafea8e36a8f540b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1c36a949b84bb69c391392f763e903" is_pre_election: true
I20260929 06:38:41.806334 23650 raft_consensus.cc:2454] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 475e2aa820ea447eafea8e36a8f540b3 in term 0.
I20260929 06:38:41.806489 23724 leader_election.cc:302] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475e2aa820ea447eafea8e36a8f540b3, cc1c36a949b84bb69c391392f763e903; no voters:
I20260929 06:38:41.806617 24012 raft_consensus.cc:2781] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:41.806658 24012 raft_consensus.cc:482] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:41.806679 24012 raft_consensus.cc:3037] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:41.807233 24001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.803585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:34263 (local address 127.15.157.131:39327)
0929 06:38:41.803624 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.803625 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.803820 (+ 195us) server_negotiation.cc:407] Connection header received
0929 06:38:41.803879 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.803880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.803888 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.803957 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:38:41.804115 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.804554 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.806407 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.806927 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.806985 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.806991 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.807164 (+ 173us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.807192 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:41.807320 24045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.803492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:39327 (local address 127.15.157.130:34263)
0929 06:38:41.803757 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.803765 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.803831 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.803958 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.803959 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.803961 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:38:41.804035 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.804037 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.804632 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.804633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.806338 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.806340 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.807008 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.807009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.807084 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.807089 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.807154 (+ 65us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.807189 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":11,"thread_start_us":53,"threads_started":1}
I20260929 06:38:41.807369 24012 raft_consensus.cc:504] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.807529 24012 leader_election.cc:288] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [CANDIDATE]: Term 1 election: Requested vote from peers cc1c36a949b84bb69c391392f763e903 (127.15.157.129:39627), c0f22a1a885b477494ee12d178710197 (127.15.157.131:39327)
I20260929 06:38:41.807641 23650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12eb28db92e4423c8fcbe597f153b641" candidate_uuid: "475e2aa820ea447eafea8e36a8f540b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1c36a949b84bb69c391392f763e903"
I20260929 06:38:41.807708 23650 raft_consensus.cc:3037] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:41.807716 23929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12eb28db92e4423c8fcbe597f153b641" candidate_uuid: "475e2aa820ea447eafea8e36a8f540b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f22a1a885b477494ee12d178710197"
I20260929 06:38:41.807713 23930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12eb28db92e4423c8fcbe597f153b641" candidate_uuid: "475e2aa820ea447eafea8e36a8f540b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f22a1a885b477494ee12d178710197" is_pre_election: true
I20260929 06:38:41.807842 23929 raft_consensus.cc:3037] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:41.808307 23650 raft_consensus.cc:2454] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 475e2aa820ea447eafea8e36a8f540b3 in term 1.
I20260929 06:38:41.808481 23724 leader_election.cc:302] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475e2aa820ea447eafea8e36a8f540b3, cc1c36a949b84bb69c391392f763e903; no voters:
I20260929 06:38:41.808570 24012 raft_consensus.cc:2781] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:41.808600 23929 raft_consensus.cc:2454] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 475e2aa820ea447eafea8e36a8f540b3 in term 1.
I20260929 06:38:41.808723 24012 raft_consensus.cc:686] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [term 1 LEADER]: Becoming Leader. State: Replica: 475e2aa820ea447eafea8e36a8f540b3, State: Running, Role: LEADER
I20260929 06:38:41.808792 24012 consensus_queue.cc:237] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } }
I20260929 06:38:41.809064 24046 tablet_replica.cc:439] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3: TxnStatusTablet state changed. Reason: New leader 475e2aa820ea447eafea8e36a8f540b3. Latest consensus state: current_term: 1 leader_uuid: "475e2aa820ea447eafea8e36a8f540b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } }
I20260929 06:38:41.809149 24046 tablet_replica.cc:442] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:38:41.809310 24048 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260929 06:38:41.809438 24048 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260929 06:38:41.809393 23493 catalog_manager.cc:5495] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 475e2aa820ea447eafea8e36a8f540b3 (127.15.157.130). New cstate: current_term: 1 leader_uuid: "475e2aa820ea447eafea8e36a8f540b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } health_report { overall_health: HEALTHY } } }
I20260929 06:38:41.818111 24041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.815587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:39271 (local address 127.0.0.1:44256)
0929 06:38:41.815641 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.815652 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.815718 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.815883 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.815884 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.815885 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:38:41.815927 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.815929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.816541 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.816542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.817194 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.817196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.817556 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.817557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.817622 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.817642 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:38:41.817917 (+ 275us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:38:41.817926 (+ 9us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.817977 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.818044 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260929 06:38:41.818101 24003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.815676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44256 (local address 127.15.157.130:39271)
0929 06:38:41.815715 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.815718 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.815726 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:41.815797 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.815798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.815814 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.815878 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:41.815977 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.816456 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.817278 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.817472 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.817555 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.817749 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:41.817842 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:41.817918 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.817982 (+ 64us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.818002 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:38:41.819139 23929 raft_consensus.cc:1261] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Refusing update from remote peer 475e2aa820ea447eafea8e36a8f540b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:41.819371 23650 raft_consensus.cc:1261] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Refusing update from remote peer 475e2aa820ea447eafea8e36a8f540b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:41.819360 24046 consensus_queue.cc:1035] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:41.819559 24046 consensus_queue.cc:1035] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:41.819986 24022 tablet_replica.cc:439] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197: TxnStatusTablet state changed. Reason: New leader 475e2aa820ea447eafea8e36a8f540b3. Latest consensus state: current_term: 1 leader_uuid: "475e2aa820ea447eafea8e36a8f540b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } }
I20260929 06:38:41.820084 24022 tablet_replica.cc:442] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:41.820350 24011 tablet_replica.cc:439] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903: TxnStatusTablet state changed. Reason: New leader 475e2aa820ea447eafea8e36a8f540b3. Latest consensus state: current_term: 1 leader_uuid: "475e2aa820ea447eafea8e36a8f540b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } }
I20260929 06:38:41.820437 24011 tablet_replica.cc:442] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:41.820966 24046 tablet_replica.cc:439] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "475e2aa820ea447eafea8e36a8f540b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } }
I20260929 06:38:41.821044 24046 tablet_replica.cc:442] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:38:41.821412 24046 tablet_replica.cc:439] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "475e2aa820ea447eafea8e36a8f540b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } }
I20260929 06:38:41.821486 24046 tablet_replica.cc:442] T 12eb28db92e4423c8fcbe597f153b641 P 475e2aa820ea447eafea8e36a8f540b3: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:38:41.821643 24022 tablet_replica.cc:439] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "475e2aa820ea447eafea8e36a8f540b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } }
I20260929 06:38:41.821727 24022 tablet_replica.cc:442] T 12eb28db92e4423c8fcbe597f153b641 P c0f22a1a885b477494ee12d178710197: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:41.821904 24011 tablet_replica.cc:439] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "475e2aa820ea447eafea8e36a8f540b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } }
I20260929 06:38:41.821990 24011 tablet_replica.cc:442] T 12eb28db92e4423c8fcbe597f153b641 P cc1c36a949b84bb69c391392f763e903: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:38:41.821933 24019 mvcc.cc:205] Tried to move back new op lower bound from 7334559423769145344 to 7334559423729258496. Current Snapshot: MvccSnapshot[applied={T|T < 7334559423769145344}]
I20260929 06:38:41.825616 24000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.822934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58872 (local address 127.15.157.129:39627)
0929 06:38:41.822995 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.822997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.823003 (+ 6us) server_negotiation.cc:407] Connection header received
0929 06:38:41.823052 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.823053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.823071 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.823144 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:41.823361 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.823819 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.824860 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.825027 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.825075 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.825237 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:41.825363 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:41.825453 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.825505 (+ 52us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.825522 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 06:38:41.831084 24055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.827963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:39271 (local address 127.15.157.129:44833)
0929 06:38:41.828136 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.828145 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.828203 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.828316 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.828317 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.828320 (+ 3us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:38:41.828377 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.828378 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.829235 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.829235 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.830280 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.830282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.830744 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.830745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.830790 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.830802 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:38:41.830960 (+ 158us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:38:41.830961 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.830995 (+ 34us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.831024 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":69,"threads_started":1}
I20260929 06:38:41.831089 24003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.828033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:44833 (local address 127.15.157.130:39271)
0929 06:38:41.828074 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.828075 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.828207 (+ 132us) server_negotiation.cc:407] Connection header received
0929 06:38:41.828248 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.828249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.828259 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.828316 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:41.828445 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.829160 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.830355 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.830666 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.830731 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.830870 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:41.830902 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:41.830956 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.830998 (+ 42us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.831017 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:38:41.833113 23929 raft_consensus.cc:1261] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Refusing update from remote peer cc1c36a949b84bb69c391392f763e903: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:41.833164 23790 raft_consensus.cc:1261] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Refusing update from remote peer cc1c36a949b84bb69c391392f763e903: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:41.833353 24011 consensus_queue.cc:1035] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:41.833528 24034 consensus_queue.cc:1035] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:41.841892 23842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.839171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:39627 (local address 127.15.157.130:48693)
0929 06:38:41.839244 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:41.839255 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:41.839293 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:41.839459 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:41.839460 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:41.839462 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:38:41.839517 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.839526 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.840089 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.840090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.841029 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:41.841032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.841500 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.841501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:41.841554 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.841567 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:38:41.841766 (+ 199us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:38:41.841768 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:38:41.841803 (+ 35us) client_negotiation.cc:240] Negotiation successful
0929 06:38:41.841837 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260929 06:38:41.841930 24000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.839211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:48693 (local address 127.15.157.129:39627)
0929 06:38:41.839367 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.839369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.839376 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:41.839394 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.839395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.839403 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.839451 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:41.839590 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.840021 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.841127 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.841423 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.841483 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.841667 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:41.841700 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:41.841761 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.841811 (+ 50us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.841838 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260929 06:38:41.850760 23493 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:41.850869 23493 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:41.851495 23493 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804: Sending DeleteTablet for 3 replicas of tablet 0ce45e48339e46f09020aa5d290c82e0
I20260929 06:38:41.851742 23630 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ce45e48339e46f09020aa5d290c82e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:41 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:58862
I20260929 06:38:41.851818 23910 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ce45e48339e46f09020aa5d290c82e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:41 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:58756
I20260929 06:38:41.851922 24029 tablet_replica.cc:330] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903: stopping tablet replica
I20260929 06:38:41.851924 24027 tablet_replica.cc:330] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197: stopping tablet replica
I20260929 06:38:41.851979 24029 raft_consensus.cc:2229] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:38:41.851981 24027 raft_consensus.cc:2229] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:41.852022 24027 raft_consensus.cc:2258] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:41.852058 24029 raft_consensus.cc:2258] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:41.852447 24027 ts_tablet_manager.cc:1905] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:41.852432 23770 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ce45e48339e46f09020aa5d290c82e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:41 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:44244
I20260929 06:38:41.852643 24029 ts_tablet_manager.cc:1905] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:41.852537 24028 tablet_replica.cc:330] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3: stopping tablet replica
I20260929 06:38:41.852735 24028 raft_consensus.cc:2229] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:41.852803 24028 raft_consensus.cc:2258] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:41.854415 24029 ts_tablet_manager.cc:1918] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:38:41.854475 24029 log.cc:1196] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/wal/wals/0ce45e48339e46f09020aa5d290c82e0
I20260929 06:38:41.854700 24029 ts_tablet_manager.cc:1939] T 0ce45e48339e46f09020aa5d290c82e0 P cc1c36a949b84bb69c391392f763e903: Deleting consensus metadata
I20260929 06:38:41.855129 23480 catalog_manager.cc:4841] TS cc1c36a949b84bb69c391392f763e903 (127.15.157.129:39627): tablet 0ce45e48339e46f09020aa5d290c82e0 (table test-table [id=d66eb18f0c5142989ee2633db0130600]) successfully deleted
I20260929 06:38:41.856864 24027 ts_tablet_manager.cc:1918] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:38:41.856928 24027 log.cc:1196] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/0ce45e48339e46f09020aa5d290c82e0
I20260929 06:38:41.857134 24027 ts_tablet_manager.cc:1939] T 0ce45e48339e46f09020aa5d290c82e0 P c0f22a1a885b477494ee12d178710197: Deleting consensus metadata
I20260929 06:38:41.857622 23478 catalog_manager.cc:4841] TS c0f22a1a885b477494ee12d178710197 (127.15.157.131:39327): tablet 0ce45e48339e46f09020aa5d290c82e0 (table test-table [id=d66eb18f0c5142989ee2633db0130600]) successfully deleted
I20260929 06:38:41.857664 24028 ts_tablet_manager.cc:1905] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:41.859195 24028 ts_tablet_manager.cc:1918] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:38:41.859261 24028 log.cc:1196] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/0ce45e48339e46f09020aa5d290c82e0
I20260929 06:38:41.859460 24028 ts_tablet_manager.cc:1939] T 0ce45e48339e46f09020aa5d290c82e0 P 475e2aa820ea447eafea8e36a8f540b3: Deleting consensus metadata
I20260929 06:38:41.859805 23480 catalog_manager.cc:4841] TS 475e2aa820ea447eafea8e36a8f540b3 (127.15.157.130:39271): tablet 0ce45e48339e46f09020aa5d290c82e0 (table test-table [id=d66eb18f0c5142989ee2633db0130600]) successfully deleted
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
W20260929 06:38:41.879208 23543 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:41.873318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56558 (local address 127.15.157.190:45439)
0929 06:38:41.873372 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.873374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.873511 (+ 137us) server_negotiation.cc:407] Connection header received
0929 06:38:41.873595 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.873596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.873607 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.873657 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:41.874275 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.875000 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.875913 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.876150 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.876229 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.879148 (+ 2919us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56558: BlockingRecv error: recv got EOF from 127.0.0.1:56558 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Sep 29 06:38:41 dist-test-slave-ltw5 krb5kdc[23448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM
I20260929 06:38:41.887418 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:41.880304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56574 (local address 127.15.157.190:45439)
0929 06:38:41.880343 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:41.880345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:41.880552 (+ 207us) server_negotiation.cc:407] Connection header received
0929 06:38:41.880624 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:41.880625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:41.880635 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:41.880706 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:41.881159 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.881627 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.882392 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:41.882586 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:41.882671 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:41.884807 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:41.884808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:41.884809 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:41.884816 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:41.886270 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.886652 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.886654 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.886654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.886710 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:41.886911 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:41.886912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:41.886912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:41.887023 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:41.887128 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:41.887229 (+ 101us) server_negotiation.cc:299] Negotiation successful
0929 06:38:41.887305 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:38:41.889067 23493 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56574:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:38:41.889251 23493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:41.890631 23630 tablet_service.cc:1467] Processing CreateTablet for tablet 7d32f834cc974878a119a1186357dfec (DEFAULT_TABLE table=test-table [id=426850646bef4ead9549be24201bd1c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:41.890693 23910 tablet_service.cc:1467] Processing CreateTablet for tablet 7d32f834cc974878a119a1186357dfec (DEFAULT_TABLE table=test-table [id=426850646bef4ead9549be24201bd1c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:41.890770 23630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d32f834cc974878a119a1186357dfec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:41.890789 23910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d32f834cc974878a119a1186357dfec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:41.892060 24006 tablet_bootstrap.cc:492] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903: Bootstrap starting.
I20260929 06:38:41.892081 23770 tablet_service.cc:1467] Processing CreateTablet for tablet 7d32f834cc974878a119a1186357dfec (DEFAULT_TABLE table=test-table [id=426850646bef4ead9549be24201bd1c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:41.892194 23770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d32f834cc974878a119a1186357dfec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:41.892484 24006 tablet_bootstrap.cc:654] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:41.893396 24007 tablet_bootstrap.cc:492] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3: Bootstrap starting.
I20260929 06:38:41.893432 24004 tablet_bootstrap.cc:492] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197: Bootstrap starting.
I20260929 06:38:41.893774 24007 tablet_bootstrap.cc:654] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:41.893774 24004 tablet_bootstrap.cc:654] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:41.894516 24004 tablet_bootstrap.cc:492] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197: No bootstrap required, opened a new log
I20260929 06:38:41.894570 24004 ts_tablet_manager.cc:1397] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:41.894680 24006 tablet_bootstrap.cc:492] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903: No bootstrap required, opened a new log
I20260929 06:38:41.894719 24006 ts_tablet_manager.cc:1397] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260929 06:38:41.894685 24004 raft_consensus.cc:348] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.894757 24004 raft_consensus.cc:374] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:41.894783 24004 raft_consensus.cc:729] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f22a1a885b477494ee12d178710197, State: Initialized, Role: FOLLOWER
I20260929 06:38:41.894827 24004 consensus_queue.cc:260] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.894856 24006 raft_consensus.cc:348] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.894909 24004 ts_tablet_manager.cc:1428] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:41.894917 24006 raft_consensus.cc:374] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:41.894939 24006 raft_consensus.cc:729] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1c36a949b84bb69c391392f763e903, State: Initialized, Role: FOLLOWER
I20260929 06:38:41.894984 24006 consensus_queue.cc:260] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.895081 24006 ts_tablet_manager.cc:1428] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:41.896235 24007 tablet_bootstrap.cc:492] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3: No bootstrap required, opened a new log
I20260929 06:38:41.896307 24007 ts_tablet_manager.cc:1397] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260929 06:38:41.896456 24007 raft_consensus.cc:348] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.896546 24007 raft_consensus.cc:374] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:41.896574 24007 raft_consensus.cc:729] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475e2aa820ea447eafea8e36a8f540b3, State: Initialized, Role: FOLLOWER
I20260929 06:38:41.896618 24007 consensus_queue.cc:260] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:41.896713 24007 ts_tablet_manager.cc:1428] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:42.004349 24022 raft_consensus.cc:482] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:42.004454 24022 raft_consensus.cc:504] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:42.004611 24022 leader_election.cc:288] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1c36a949b84bb69c391392f763e903 (127.15.157.129:39627), 475e2aa820ea447eafea8e36a8f540b3 (127.15.157.130:39271)
I20260929 06:38:42.004806 23650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d32f834cc974878a119a1186357dfec" candidate_uuid: "c0f22a1a885b477494ee12d178710197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1c36a949b84bb69c391392f763e903" is_pre_election: true
I20260929 06:38:42.004827 23790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d32f834cc974878a119a1186357dfec" candidate_uuid: "c0f22a1a885b477494ee12d178710197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475e2aa820ea447eafea8e36a8f540b3" is_pre_election: true
I20260929 06:38:42.004894 23650 raft_consensus.cc:2454] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f22a1a885b477494ee12d178710197 in term 0.
I20260929 06:38:42.004904 23790 raft_consensus.cc:2454] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f22a1a885b477494ee12d178710197 in term 0.
I20260929 06:38:42.005044 23864 leader_election.cc:302] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f22a1a885b477494ee12d178710197, cc1c36a949b84bb69c391392f763e903; no voters:
I20260929 06:38:42.005149 24022 raft_consensus.cc:2781] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:42.005183 24022 raft_consensus.cc:482] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:42.005205 24022 raft_consensus.cc:3037] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:42.005923 24022 raft_consensus.cc:504] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:42.006078 24022 leader_election.cc:288] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [CANDIDATE]: Term 1 election: Requested vote from peers cc1c36a949b84bb69c391392f763e903 (127.15.157.129:39627), 475e2aa820ea447eafea8e36a8f540b3 (127.15.157.130:39271)
I20260929 06:38:42.006243 23790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d32f834cc974878a119a1186357dfec" candidate_uuid: "c0f22a1a885b477494ee12d178710197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475e2aa820ea447eafea8e36a8f540b3"
I20260929 06:38:42.006260 23650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d32f834cc974878a119a1186357dfec" candidate_uuid: "c0f22a1a885b477494ee12d178710197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1c36a949b84bb69c391392f763e903"
I20260929 06:38:42.006341 23790 raft_consensus.cc:3037] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:42.006361 23650 raft_consensus.cc:3037] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:42.006965 23650 raft_consensus.cc:2454] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f22a1a885b477494ee12d178710197 in term 1.
I20260929 06:38:42.007083 23790 raft_consensus.cc:2454] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f22a1a885b477494ee12d178710197 in term 1.
I20260929 06:38:42.007140 23864 leader_election.cc:302] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f22a1a885b477494ee12d178710197, cc1c36a949b84bb69c391392f763e903; no voters:
I20260929 06:38:42.007249 24022 raft_consensus.cc:2781] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:42.007300 24022 raft_consensus.cc:686] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [term 1 LEADER]: Becoming Leader. State: Replica: c0f22a1a885b477494ee12d178710197, State: Running, Role: LEADER
I20260929 06:38:42.007365 24022 consensus_queue.cc:237] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:42.008040 23493 catalog_manager.cc:5495] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f22a1a885b477494ee12d178710197 (127.15.157.131). New cstate: current_term: 1 leader_uuid: "c0f22a1a885b477494ee12d178710197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } health_report { overall_health: HEALTHY } } }
I20260929 06:38:42.013309 24001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:42.010999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58772 (local address 127.15.157.131:39327)
0929 06:38:42.011066 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:42.011068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:42.011076 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:42.011100 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:42.011100 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:42.011110 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:42.011171 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:42.011320 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:42.011803 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:42.012580 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:42.012796 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:42.012881 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:42.013043 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:42.013076 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:42.013146 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:42.013205 (+ 59us) server_negotiation.cc:299] Negotiation successful
0929 06:38:42.013227 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 06:38:42.014006 23650 raft_consensus.cc:1261] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Refusing update from remote peer c0f22a1a885b477494ee12d178710197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:42.014007 23790 raft_consensus.cc:1261] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Refusing update from remote peer c0f22a1a885b477494ee12d178710197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:42.014247 24014 consensus_queue.cc:1035] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:42.014384 24022 consensus_queue.cc:1035] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:42.016569 23492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:42.016655 23492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:42.017282 23492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804: Sending DeleteTablet for 3 replicas of tablet 7d32f834cc974878a119a1186357dfec
I20260929 06:38:42.017601 23909 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d32f834cc974878a119a1186357dfec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:42 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:58756
I20260929 06:38:42.017649 23770 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d32f834cc974878a119a1186357dfec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:42 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:44244
I20260929 06:38:42.017688 24027 tablet_replica.cc:330] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197: stopping tablet replica
I20260929 06:38:42.017738 24027 raft_consensus.cc:2229] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:38:42.017746 23910 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d32f834cc974878a119a1186357dfec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:42 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:58756
I20260929 06:38:42.017783 24027 raft_consensus.cc:2258] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:42.017818 24028 tablet_replica.cc:330] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3: stopping tablet replica
I20260929 06:38:42.017870 24028 raft_consensus.cc:2229] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:42.017906 24028 pending_rounds.cc:62] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3: Trying to abort 2 pending ops.
I20260929 06:38:42.017824 23491 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56574:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:38:42.017961 23491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:38:42.018154 23630 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d32f834cc974878a119a1186357dfec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:42 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:58862
I20260929 06:38:42.018235 23629 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d32f834cc974878a119a1186357dfec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:42 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:58862
I20260929 06:38:42.018303 24029 tablet_replica.cc:330] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903: stopping tablet replica
I20260929 06:38:42.018347 24029 raft_consensus.cc:2229] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:42.018385 24029 raft_consensus.cc:2258] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:42.018388 24027 ts_tablet_manager.cc:1905] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:42.017923 24028 pending_rounds.cc:68] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7334559424567853056 op_type: WRITE_OP write_request { tablet_id: "7d32f834cc974878a119a1186357dfec" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\236\274\355\325\006\"8\n\ntest-admin\022*\n 426850646bef4ead9549be24201bd1c5\020\001\030\001 \001(\001" signature: "<redacted>""\037\010\370b\0029\214\254\334\355\264\265\264H\220\273\202b>\252G\233\267\t\016\215\234\347A\366\263\357\247\027]XD\221K\376\375\256\342\344\250\367]\n\362\214+\2465\316\257\322[#\037#\203\316\033\276" signing_key_seq_num: 0 } } request_id { client_id: "784ec14731514ccf83b82996a7d0d14b" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260929 06:38:42.018810 24028 pending_rounds.cc:68] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334559424542564352 op_type: NO_OP noop_request { }
I20260929 06:38:42.018854 24028 raft_consensus.cc:2866] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260929 06:38:42.018878 24028 raft_consensus.cc:2258] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:42.019078 23910 tablet_service.cc:1467] Processing CreateTablet for tablet 4e37b7418f49458796a5dbf534966b6d (DEFAULT_TABLE table=test-table [id=b9c7591586484a769fbc2ee14e36ce02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:42.019258 23910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e37b7418f49458796a5dbf534966b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:42.019397 24029 ts_tablet_manager.cc:1905] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:42.020051 24027 ts_tablet_manager.cc:1918] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:42.020102 24027 log.cc:1196] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/7d32f834cc974878a119a1186357dfec
I20260929 06:38:42.020246 23770 tablet_service.cc:1467] Processing CreateTablet for tablet 4e37b7418f49458796a5dbf534966b6d (DEFAULT_TABLE table=test-table [id=b9c7591586484a769fbc2ee14e36ce02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:42.020334 24027 ts_tablet_manager.cc:1939] T 7d32f834cc974878a119a1186357dfec P c0f22a1a885b477494ee12d178710197: Deleting consensus metadata
I20260929 06:38:42.020349 23770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e37b7418f49458796a5dbf534966b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:42.020572 24004 tablet_bootstrap.cc:492] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197: Bootstrap starting.
I20260929 06:38:42.020862 24004 tablet_bootstrap.cc:654] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:42.020884 24029 ts_tablet_manager.cc:1918] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:42.020931 24029 log.cc:1196] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-0/wal/wals/7d32f834cc974878a119a1186357dfec
I20260929 06:38:42.021142 24029 ts_tablet_manager.cc:1939] T 7d32f834cc974878a119a1186357dfec P cc1c36a949b84bb69c391392f763e903: Deleting consensus metadata
I20260929 06:38:42.021335 23629 tablet_service.cc:1467] Processing CreateTablet for tablet 4e37b7418f49458796a5dbf534966b6d (DEFAULT_TABLE table=test-table [id=b9c7591586484a769fbc2ee14e36ce02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:38:42.021380 23478 catalog_manager.cc:4841] TS c0f22a1a885b477494ee12d178710197 (127.15.157.131:39327): tablet 7d32f834cc974878a119a1186357dfec (table test-table [id=426850646bef4ead9549be24201bd1c5]) successfully deleted
I20260929 06:38:42.021425 23629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e37b7418f49458796a5dbf534966b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:42.021531 24004 tablet_bootstrap.cc:492] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197: No bootstrap required, opened a new log
W20260929 06:38:42.021517 23478 catalog_manager.cc:4808] TS c0f22a1a885b477494ee12d178710197 (127.15.157.131:39327): delete failed for tablet 7d32f834cc974878a119a1186357dfec because the tablet was not found. No further retry: Not found: Tablet not found: 7d32f834cc974878a119a1186357dfec
I20260929 06:38:42.021569 24004 ts_tablet_manager.cc:1397] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:42.021629 24007 tablet_bootstrap.cc:492] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3: Bootstrap starting.
I20260929 06:38:42.021658 24004 raft_consensus.cc:348] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:42.021714 24004 raft_consensus.cc:374] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:42.021733 24004 raft_consensus.cc:729] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f22a1a885b477494ee12d178710197, State: Initialized, Role: FOLLOWER
I20260929 06:38:42.021778 24004 consensus_queue.cc:260] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:42.021857 24004 ts_tablet_manager.cc:1428] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:42.021944 24007 tablet_bootstrap.cc:654] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:42.022241 23480 catalog_manager.cc:4841] TS cc1c36a949b84bb69c391392f763e903 (127.15.157.129:39627): tablet 7d32f834cc974878a119a1186357dfec (table test-table [id=426850646bef4ead9549be24201bd1c5]) successfully deleted
W20260929 06:38:42.022297 23480 catalog_manager.cc:4808] TS cc1c36a949b84bb69c391392f763e903 (127.15.157.129:39627): delete failed for tablet 7d32f834cc974878a119a1186357dfec because the tablet was not found. No further retry: Not found: Tablet not found: 7d32f834cc974878a119a1186357dfec
I20260929 06:38:42.022650 24007 tablet_bootstrap.cc:492] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3: No bootstrap required, opened a new log
I20260929 06:38:42.022706 24007 ts_tablet_manager.cc:1397] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:42.022746 24006 tablet_bootstrap.cc:492] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903: Bootstrap starting.
I20260929 06:38:42.022819 24007 raft_consensus.cc:348] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:42.022897 24007 raft_consensus.cc:374] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:42.022915 24007 raft_consensus.cc:729] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475e2aa820ea447eafea8e36a8f540b3, State: Initialized, Role: FOLLOWER
I20260929 06:38:42.022960 24007 consensus_queue.cc:260] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:42.023027 24006 tablet_bootstrap.cc:654] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:42.023074 24007 ts_tablet_manager.cc:1428] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:42.023448 24028 ts_tablet_manager.cc:1905] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:42.023609 24006 tablet_bootstrap.cc:492] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903: No bootstrap required, opened a new log
I20260929 06:38:42.023644 24006 ts_tablet_manager.cc:1397] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260929 06:38:42.023746 24006 raft_consensus.cc:348] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:42.023808 24006 raft_consensus.cc:374] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:42.023825 24006 raft_consensus.cc:729] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1c36a949b84bb69c391392f763e903, State: Initialized, Role: FOLLOWER
I20260929 06:38:42.023862 24006 consensus_queue.cc:260] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:42.023947 24006 ts_tablet_manager.cc:1428] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:42.024778 24028 ts_tablet_manager.cc:1918] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:38:42.024837 24028 log.cc:1196] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/7d32f834cc974878a119a1186357dfec
I20260929 06:38:42.024982 24028 ts_tablet_manager.cc:1939] T 7d32f834cc974878a119a1186357dfec P 475e2aa820ea447eafea8e36a8f540b3: Deleting consensus metadata
I20260929 06:38:42.025408 23480 catalog_manager.cc:4841] TS 475e2aa820ea447eafea8e36a8f540b3 (127.15.157.130:39271): tablet 7d32f834cc974878a119a1186357dfec (table test-table [id=426850646bef4ead9549be24201bd1c5]) successfully deleted
I20260929 06:38:42.122404 24011 raft_consensus.cc:482] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:38:42.122506 24011 raft_consensus.cc:504] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:42.122697 24011 leader_election.cc:288] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 475e2aa820ea447eafea8e36a8f540b3 (127.15.157.130:39271), c0f22a1a885b477494ee12d178710197 (127.15.157.131:39327)
I20260929 06:38:42.122931 23929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e37b7418f49458796a5dbf534966b6d" candidate_uuid: "cc1c36a949b84bb69c391392f763e903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f22a1a885b477494ee12d178710197" is_pre_election: true
I20260929 06:38:42.122946 23790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e37b7418f49458796a5dbf534966b6d" candidate_uuid: "cc1c36a949b84bb69c391392f763e903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475e2aa820ea447eafea8e36a8f540b3" is_pre_election: true
I20260929 06:38:42.123034 23790 raft_consensus.cc:2454] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1c36a949b84bb69c391392f763e903 in term 0.
I20260929 06:38:42.123034 23929 raft_consensus.cc:2454] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1c36a949b84bb69c391392f763e903 in term 0.
I20260929 06:38:42.123202 23582 leader_election.cc:302] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f22a1a885b477494ee12d178710197, cc1c36a949b84bb69c391392f763e903; no voters:
I20260929 06:38:42.123322 24011 raft_consensus.cc:2781] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:38:42.123364 24011 raft_consensus.cc:482] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:38:42.123386 24011 raft_consensus.cc:3037] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:42.124022 24011 raft_consensus.cc:504] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:42.124163 24011 leader_election.cc:288] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [CANDIDATE]: Term 1 election: Requested vote from peers 475e2aa820ea447eafea8e36a8f540b3 (127.15.157.130:39271), c0f22a1a885b477494ee12d178710197 (127.15.157.131:39327)
I20260929 06:38:42.124321 23790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e37b7418f49458796a5dbf534966b6d" candidate_uuid: "cc1c36a949b84bb69c391392f763e903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475e2aa820ea447eafea8e36a8f540b3"
I20260929 06:38:42.124321 23929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e37b7418f49458796a5dbf534966b6d" candidate_uuid: "cc1c36a949b84bb69c391392f763e903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f22a1a885b477494ee12d178710197"
I20260929 06:38:42.124402 23790 raft_consensus.cc:3037] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:42.124402 23929 raft_consensus.cc:3037] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:42.125138 23790 raft_consensus.cc:2454] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1c36a949b84bb69c391392f763e903 in term 1.
I20260929 06:38:42.125138 23929 raft_consensus.cc:2454] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1c36a949b84bb69c391392f763e903 in term 1.
I20260929 06:38:42.125313 23582 leader_election.cc:302] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f22a1a885b477494ee12d178710197, cc1c36a949b84bb69c391392f763e903; no voters:
I20260929 06:38:42.125428 24011 raft_consensus.cc:2781] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:42.125511 24011 raft_consensus.cc:686] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [term 1 LEADER]: Becoming Leader. State: Replica: cc1c36a949b84bb69c391392f763e903, State: Running, Role: LEADER
I20260929 06:38:42.125571 24011 consensus_queue.cc:237] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } }
I20260929 06:38:42.126176 23492 catalog_manager.cc:5495] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc1c36a949b84bb69c391392f763e903 (127.15.157.129). New cstate: current_term: 1 leader_uuid: "cc1c36a949b84bb69c391392f763e903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1c36a949b84bb69c391392f763e903" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 39627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 } health_report { overall_health: UNKNOWN } } }
W20260929 06:38:42.141506 23837 tablet.cc:2369] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:38:42.144066 24000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:42.141691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58876 (local address 127.15.157.129:39627)
0929 06:38:42.141742 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:42.141743 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:42.141854 (+ 111us) server_negotiation.cc:407] Connection header received
0929 06:38:42.141961 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:42.141962 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:42.141974 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:42.142043 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:42.142143 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:42.142630 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:42.143366 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:42.143570 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:42.143654 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:42.143804 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:42.143843 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:42.143904 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:42.143963 (+ 59us) server_negotiation.cc:299] Negotiation successful
0929 06:38:42.143985 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:38:42.146127 23929 raft_consensus.cc:1261] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Refusing update from remote peer cc1c36a949b84bb69c391392f763e903: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:42.146162 23790 raft_consensus.cc:1261] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Refusing update from remote peer cc1c36a949b84bb69c391392f763e903: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:42.146329 24011 consensus_queue.cc:1035] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f22a1a885b477494ee12d178710197" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:42.146427 24061 consensus_queue.cc:1035] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "475e2aa820ea447eafea8e36a8f540b3" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:42.157009 23491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:42.157153 23491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:38:42.157768 23491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bef0983fb2864ba99052f2c0f68e9804: Sending DeleteTablet for 3 replicas of tablet 4e37b7418f49458796a5dbf534966b6d
I20260929 06:38:42.157994 23629 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e37b7418f49458796a5dbf534966b6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:42 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:58862
I20260929 06:38:42.158031 23910 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e37b7418f49458796a5dbf534966b6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:42 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:58756
I20260929 06:38:42.158068 23770 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e37b7418f49458796a5dbf534966b6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:38:42 UTC) from {username='oryx', principal='oryx/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:44244
I20260929 06:38:42.158108 24029 tablet_replica.cc:330] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903: stopping tablet replica
I20260929 06:38:42.158116 24027 tablet_replica.cc:330] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197: stopping tablet replica
I20260929 06:38:42.158175 24029 raft_consensus.cc:2229] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:38:42.158188 24027 raft_consensus.cc:2229] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:42.158232 24029 raft_consensus.cc:2258] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:42.158236 24027 raft_consensus.cc:2258] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:42.158247 24028 tablet_replica.cc:330] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3: stopping tablet replica
I20260929 06:38:42.158295 24028 raft_consensus.cc:2229] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:38:42.158324 24028 raft_consensus.cc:2258] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:38:42.158511 24027 ts_tablet_manager.cc:1905] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:42.158567 24029 ts_tablet_manager.cc:1905] T 4e37b7418f49458796a5dbf534966b6d P cc1c36a949b84bb69c391392f763e903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:42.158835 24028 ts_tablet_manager.cc:1905] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:38:42.158946 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 23565
I20260929 06:38:42.160171 24027 ts_tablet_manager.cc:1918] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:38:42.160220 24027 log.cc:1196] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/4e37b7418f49458796a5dbf534966b6d
I20260929 06:38:42.160439 24027 ts_tablet_manager.cc:1939] T 4e37b7418f49458796a5dbf534966b6d P c0f22a1a885b477494ee12d178710197: Deleting consensus metadata
I20260929 06:38:42.160531 24028 ts_tablet_manager.cc:1918] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:38:42.160586 24028 log.cc:1196] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/4e37b7418f49458796a5dbf534966b6d
I20260929 06:38:42.160729 23478 catalog_manager.cc:4841] TS c0f22a1a885b477494ee12d178710197 (127.15.157.131:39327): tablet 4e37b7418f49458796a5dbf534966b6d (table test-table [id=b9c7591586484a769fbc2ee14e36ce02]) successfully deleted
I20260929 06:38:42.160786 24028 ts_tablet_manager.cc:1939] T 4e37b7418f49458796a5dbf534966b6d P 475e2aa820ea447eafea8e36a8f540b3: Deleting consensus metadata
I20260929 06:38:42.161149 23480 catalog_manager.cc:4841] TS 475e2aa820ea447eafea8e36a8f540b3 (127.15.157.130:39271): tablet 4e37b7418f49458796a5dbf534966b6d (table test-table [id=b9c7591586484a769fbc2ee14e36ce02]) successfully deleted
W20260929 06:38:42.166898 23480 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:39627 (error 108)
I20260929 06:38:42.167057 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 23705
I20260929 06:38:42.170470 24089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:42.170291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:39627 (local address 127.0.0.1:58888)
0929 06:38:42.170387 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:42.170434 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:39627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":59,"threads_started":1}
W20260929 06:38:42.170585 23480 catalog_manager.cc:4584] TS cc1c36a949b84bb69c391392f763e903 (127.15.157.129:39627): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4e37b7418f49458796a5dbf534966b6d: Network error: Client connection negotiation failed: client connection to 127.15.157.129:39627: connect: Connection refused (error 111)
I20260929 06:38:42.173214 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 23845
I20260929 06:38:42.178423 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 23461
2026-09-29T06:38:42Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2436 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:42 dist-test-slave-ltw5 krb5kdc[24092](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:42 dist-test-slave-ltw5 krb5kdc[24092](info): set up 2 sockets
Sep 29 06:38:42 dist-test-slave-ltw5 krb5kdc[24092](info): commencing operation
krb5kdc: starting...
W20260929 06:38:43.230577 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:38:43 dist-test-slave-ltw5 krb5kdc[24092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:38:43.348877 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:40647
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:38835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:40647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:43.433123 24105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:43.433314 24105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:43.433336 24105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:43.434430 24105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:43.434470 24105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:43.434484 24105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:43.434497 24105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:43.434509 24105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:43.435904 24105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:38835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:40647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:40647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:43.436092 24105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:43.436266 24105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:43.440901 24110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:43.440935 24111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:43.440968 24113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:43.441068 24105 server_base.cc:1034] running on GCE node
I20260929 06:38:43.441294 24105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:43.441525 24105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:43.442689 24105 hybrid_clock.cc:648] HybridClock initialized: now 1790663923442675 us; error 25 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-09-29T06:38:43Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1267 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:43 dist-test-slave-ltw5 krb5kdc[24118](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:43 dist-test-slave-ltw5 krb5kdc[24118](info): set up 2 sockets
Sep 29 06:38:43 dist-test-slave-ltw5 krb5kdc[24118](info): commencing operation
krb5kdc: starting...
W20260929 06:38:44.478843 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.012s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:38:44 dist-test-slave-ltw5 krb5kdc[24118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663924, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:38:44.598857 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45293
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:45293
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:44.679044 24131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:44.679299 24131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:44.679334 24131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:44.680445 24131 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:44.680517 24131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:44.680542 24131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:44.680563 24131 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:44.680593 24131 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:44.682055 24131 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:45293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:44.682332 24131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:44.682555 24131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:44.687237 24136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:44.687278 24137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:44.687250 24131 server_base.cc:1034] running on GCE node
W20260929 06:38:44.687260 24139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:44.687750 24131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:44.688022 24131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:44.689174 24131 hybrid_clock.cc:648] HybridClock initialized: now 1790663924689164 us; error 41 us; skew 500 ppm
Sep 29 06:38:44 dist-test-slave-ltw5 krb5kdc[24118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663924, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:44.691563 24131 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:38:44.691924 24131 webserver.cc:460] Webserver started at http://127.15.157.190:43955/ using document root <none> and password file <none>
I20260929 06:38:44.692154 24131 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:44.692224 24131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:44.692384 24131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:44.693415 24131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "bd02f1b6e07a4deca106707f8ac50a85"
format_stamp: "Formatted at 2026-09-29 06:38:44 on dist-test-slave-ltw5"
server_key: "b9e2db952e7e1973602bccd23e162b96"
server_key_iv: "c20fbe1b74ac3da2a0b67c0dd5e0a29c"
server_key_version: "encryptionkey@0"
I20260929 06:38:44.693780 24131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "bd02f1b6e07a4deca106707f8ac50a85"
format_stamp: "Formatted at 2026-09-29 06:38:44 on dist-test-slave-ltw5"
server_key: "b9e2db952e7e1973602bccd23e162b96"
server_key_iv: "c20fbe1b74ac3da2a0b67c0dd5e0a29c"
server_key_version: "encryptionkey@0"
I20260929 06:38:44.695140 24131 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:38:44.695838 24146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:44.695998 24131 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:44.696095 24131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "bd02f1b6e07a4deca106707f8ac50a85"
format_stamp: "Formatted at 2026-09-29 06:38:44 on dist-test-slave-ltw5"
server_key: "b9e2db952e7e1973602bccd23e162b96"
server_key_iv: "c20fbe1b74ac3da2a0b67c0dd5e0a29c"
server_key_version: "encryptionkey@0"
I20260929 06:38:44.696182 24131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:44.707541 24131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:44.709273 24131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:44.709422 24131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:44.713290 24131 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:45293
I20260929 06:38:44.713320 24198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:45293 every 8 connection(s)
I20260929 06:38:44.713642 24131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:44.714473 24199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:44.716533 24199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85: Bootstrap starting.
I20260929 06:38:44.717021 24199 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:44.717242 24199 log.cc:824] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:44.717852 24199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85: No bootstrap required, opened a new log
I20260929 06:38:44.719435 24199 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd02f1b6e07a4deca106707f8ac50a85" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45293 } }
I20260929 06:38:44.719596 24199 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:44.719622 24199 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd02f1b6e07a4deca106707f8ac50a85, State: Initialized, Role: FOLLOWER
I20260929 06:38:44.719758 24199 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd02f1b6e07a4deca106707f8ac50a85" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45293 } }
I20260929 06:38:44.719836 24199 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:44.719858 24199 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:44.719885 24199 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:44.720322 24199 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd02f1b6e07a4deca106707f8ac50a85" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45293 } }
I20260929 06:38:44.720398 24199 leader_election.cc:302] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd02f1b6e07a4deca106707f8ac50a85; no voters:
I20260929 06:38:44.720513 24199 leader_election.cc:288] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:44.720592 24202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:44.720762 24199 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:44.720762 24202 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 1 LEADER]: Becoming Leader. State: Replica: bd02f1b6e07a4deca106707f8ac50a85, State: Running, Role: LEADER
I20260929 06:38:44.720970 24202 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd02f1b6e07a4deca106707f8ac50a85" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45293 } }
I20260929 06:38:44.721568 24203 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd02f1b6e07a4deca106707f8ac50a85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd02f1b6e07a4deca106707f8ac50a85" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45293 } } }
I20260929 06:38:44.721602 24204 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd02f1b6e07a4deca106707f8ac50a85. Latest consensus state: current_term: 1 leader_uuid: "bd02f1b6e07a4deca106707f8ac50a85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd02f1b6e07a4deca106707f8ac50a85" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45293 } } }
I20260929 06:38:44.721668 24203 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:44.721670 24204 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:44.721921 24212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:44.722460 24212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:44.723366 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 24131
I20260929 06:38:44.723496 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:38:44.723676 15990 external_mini_cluster.cc:1428] Setting key 93c8f1bf045433594a01e6f8143c01bc
I20260929 06:38:44.724014 24212 catalog_manager.cc:1347] Generated new cluster ID: e06e1835e6cf4889a330b6ee2ba4bf52
I20260929 06:38:44.724071 24212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:38:44 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663924, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:44.732275 24212 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:44.732940 24212 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:44.735100 24222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:44.724257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35414 (local address 127.15.157.190:45293)
0929 06:38:44.724396 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:44.724404 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:44.724434 (+ 30us) server_negotiation.cc:407] Connection header received
0929 06:38:44.724554 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:44.724561 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:44.724613 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:44.724764 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:44.725436 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:44.726936 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:44.727952 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:44.728599 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:44.728737 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:44.731489 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:44.731493 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:44.731494 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:44.731507 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:44.733514 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:44.733916 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:44.733918 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:44.733919 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:44.734044 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:44.734232 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:44.734233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:44.734233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:44.734488 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:44.734633 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:44.734744 (+ 111us) server_negotiation.cc:299] Negotiation successful
0929 06:38:44.734872 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":60,"threads_started":1}
I20260929 06:38:44.739931 24212 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85: Generated new TSK 0
I20260929 06:38:44.740082 24212 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:38:44.770872 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45293
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:44.869388 24225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:44.869629 24225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:44.869668 24225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:44.870901 24225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:44.870965 24225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:44.871009 24225 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:44.872459 24225 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:44.872728 24225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:44.872948 24225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:44.877985 24231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:44.878153 24225 server_base.cc:1034] running on GCE node
W20260929 06:38:44.877959 24230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:44.877969 24233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:44.878438 24225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:44.878690 24225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:44.879853 24225 hybrid_clock.cc:648] HybridClock initialized: now 1790663924879850 us; error 38 us; skew 500 ppm
Sep 29 06:38:44 dist-test-slave-ltw5 krb5kdc[24118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663924, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:44.882270 24225 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:38:44.882740 24225 webserver.cc:460] Webserver started at http://127.15.157.129:42221/ using document root <none> and password file <none>
I20260929 06:38:44.882972 24225 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:44.883039 24225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:44.883170 24225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:44.884284 24225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "41e690f759bc4bf08d393ae8c3c7883d"
format_stamp: "Formatted at 2026-09-29 06:38:44 on dist-test-slave-ltw5"
server_key: "679da8646495f12ea986bfcbbea3d6b4"
server_key_iv: "3e16aa85fb7226e3ba5095a4241c9e48"
server_key_version: "encryptionkey@0"
I20260929 06:38:44.884635 24225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "41e690f759bc4bf08d393ae8c3c7883d"
format_stamp: "Formatted at 2026-09-29 06:38:44 on dist-test-slave-ltw5"
server_key: "679da8646495f12ea986bfcbbea3d6b4"
server_key_iv: "3e16aa85fb7226e3ba5095a4241c9e48"
server_key_version: "encryptionkey@0"
I20260929 06:38:44.885926 24225 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260929 06:38:44.886641 24240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:44.886813 24225 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:44.886909 24225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "41e690f759bc4bf08d393ae8c3c7883d"
format_stamp: "Formatted at 2026-09-29 06:38:44 on dist-test-slave-ltw5"
server_key: "679da8646495f12ea986bfcbbea3d6b4"
server_key_iv: "3e16aa85fb7226e3ba5095a4241c9e48"
server_key_version: "encryptionkey@0"
I20260929 06:38:44.886986 24225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:44.912293 24225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:44.914356 24225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:44.914467 24225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:44.914657 24225 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:44.914981 24225 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:44.915040 24225 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:44.915083 24225 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:44.915131 24225 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:44.921094 24225 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:44805
I20260929 06:38:44.921144 24353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:44805 every 8 connection(s)
I20260929 06:38:44.921571 24225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:38:44.926365 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 24225
I20260929 06:38:44.926443 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:38:44.926616 15990 external_mini_cluster.cc:1428] Setting key 4db7824e4ebfdb0483ac95e19489fc9e
Sep 29 06:38:44 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663924, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:44.931605 24222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:44.922316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:45995 (local address 127.15.157.190:45293)
0929 06:38:44.922360 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:44.922362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:44.922613 (+ 251us) server_negotiation.cc:407] Connection header received
0929 06:38:44.923145 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:44.923146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:44.923159 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:44.923222 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:44.924153 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:44.924664 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:44.925646 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:44.925860 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:44.925945 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:44.928589 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:44.928590 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:44.928591 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:44.928599 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:44.930138 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:44.930644 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:44.930645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:44.930646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:44.930699 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:44.930993 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:44.930994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:44.930994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:44.931090 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:44.931139 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:44.931477 (+ 338us) server_negotiation.cc:299] Negotiation successful
0929 06:38:44.931544 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:38:44.931937 24356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:44.922296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:45995)
0929 06:38:44.922474 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:44.922525 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:44.923039 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:44.923292 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:44.923296 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:44.923858 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:44.924050 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:44.924054 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:44.924759 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:44.924760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:44.925553 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:44.925555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:44.925956 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:44.925957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:44.926108 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:44.926726 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:44.926737 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:44.928489 (+ 1752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:44.930214 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:44.930222 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:44.930224 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:44.930551 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:44.930762 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:44.930763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:44.930763 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:44.930921 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:44.931156 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:44.931163 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:44.931335 (+ 172us) client_negotiation.cc:769] Sending connection context
0929 06:38:44.931458 (+ 123us) client_negotiation.cc:240] Negotiation successful
0929 06:38:44.931644 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
I20260929 06:38:44.932487 24354 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45293
I20260929 06:38:44.932581 24354 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:44.932782 24354 heartbeater.cc:511] Master 127.15.157.190:45293 requested a full tablet report, sending...
I20260929 06:38:44.933274 24163 ts_manager.cc:194] Registered new tserver with Master: 41e690f759bc4bf08d393ae8c3c7883d (127.15.157.129:44805)
I20260929 06:38:44.933864 24163 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:45995
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:38:44.952664 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45293
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:45.033269 24359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:45.033540 24359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:45.033579 24359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:45.034803 24359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:45.034876 24359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:45.034920 24359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:45.036365 24359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:45.036629 24359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:45.036855 24359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:45.041735 24367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:45.041731 24365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:45.041821 24364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:45.041960 24359 server_base.cc:1034] running on GCE node
I20260929 06:38:45.042200 24359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:45.042389 24359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:45.043520 24359 hybrid_clock.cc:648] HybridClock initialized: now 1790663925043500 us; error 43 us; skew 500 ppm
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663925, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:45.046110 24359 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:38:45.046633 24359 webserver.cc:460] Webserver started at http://127.15.157.130:33321/ using document root <none> and password file <none>
I20260929 06:38:45.046860 24359 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:45.046929 24359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:45.047083 24359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:45.048092 24359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "b8daf34f991144af84d4f88d0b6d43eb"
format_stamp: "Formatted at 2026-09-29 06:38:45 on dist-test-slave-ltw5"
server_key: "551c44d185a94031430abeae0c46d97f"
server_key_iv: "314297aaf56109750c756c56e1448b46"
server_key_version: "encryptionkey@0"
I20260929 06:38:45.048463 24359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "b8daf34f991144af84d4f88d0b6d43eb"
format_stamp: "Formatted at 2026-09-29 06:38:45 on dist-test-slave-ltw5"
server_key: "551c44d185a94031430abeae0c46d97f"
server_key_iv: "314297aaf56109750c756c56e1448b46"
server_key_version: "encryptionkey@0"
I20260929 06:38:45.049774 24359 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:38:45.050536 24374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.050694 24359 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.050802 24359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "b8daf34f991144af84d4f88d0b6d43eb"
format_stamp: "Formatted at 2026-09-29 06:38:45 on dist-test-slave-ltw5"
server_key: "551c44d185a94031430abeae0c46d97f"
server_key_iv: "314297aaf56109750c756c56e1448b46"
server_key_version: "encryptionkey@0"
I20260929 06:38:45.050887 24359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:45.059288 24359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:45.061574 24359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:45.061738 24359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:45.061960 24359 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:45.062278 24359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:45.062332 24359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.062371 24359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:45.062398 24359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.068166 24359 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:34091
I20260929 06:38:45.068199 24487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:34091 every 8 connection(s)
I20260929 06:38:45.068504 24359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663925, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:45.077360 24222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:45.069181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:48119 (local address 127.15.157.190:45293)
0929 06:38:45.069224 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:45.069225 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:45.069440 (+ 215us) server_negotiation.cc:407] Connection header received
0929 06:38:45.069968 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:45.069970 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:45.069982 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:45.070058 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:45.070999 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.071492 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.072472 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.072664 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.072748 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.074819 (+ 2071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:45.074821 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:45.074821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:45.074839 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:45.075982 (+ 1143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:45.076381 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:45.076382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:45.076382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:45.076441 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:45.076700 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:45.076701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:45.076702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:45.076814 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:45.076889 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:45.077148 (+ 259us) server_negotiation.cc:299] Negotiation successful
0929 06:38:45.077268 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:38:45.077394 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 24359
I20260929 06:38:45.077503 24490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:45.069166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:48119)
0929 06:38:45.069325 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:45.069357 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:45.069857 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:45.070138 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:45.070142 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:45.070704 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:45.070888 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.070892 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.071579 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.071580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.072371 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.072373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.072768 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.072769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.072889 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.073334 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:45.073341 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:45.074724 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:45.076077 (+ 1353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:45.076083 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:45.076085 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:45.076303 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:45.076506 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:45.076507 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:45.076507 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:45.076617 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:45.076879 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:45.076885 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:45.077021 (+ 136us) client_negotiation.cc:769] Sending connection context
0929 06:38:45.077129 (+ 108us) client_negotiation.cc:240] Negotiation successful
0929 06:38:45.077280 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
I20260929 06:38:45.077519 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:38:45.077702 15990 external_mini_cluster.cc:1428] Setting key 7f366efbaf836a1b69209484266cf355
I20260929 06:38:45.077899 24488 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45293
I20260929 06:38:45.077991 24488 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:45.078181 24488 heartbeater.cc:511] Master 127.15.157.190:45293 requested a full tablet report, sending...
I20260929 06:38:45.078626 24163 ts_manager.cc:194] Registered new tserver with Master: b8daf34f991144af84d4f88d0b6d43eb (127.15.157.130:34091)
I20260929 06:38:45.079142 24163 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:48119
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:38:45.104542 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45293
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:45.184077 24493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:45.184283 24493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:45.184305 24493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:45.185389 24493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:45.185421 24493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:45.185446 24493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:45.186887 24493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:45293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:45.187076 24493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:45.187252 24493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:45.192229 24501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:45.192207 24498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:45.192341 24493 server_base.cc:1034] running on GCE node
W20260929 06:38:45.192203 24499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:45.192605 24493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:45.192842 24493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:45.193998 24493 hybrid_clock.cc:648] HybridClock initialized: now 1790663925193983 us; error 27 us; skew 500 ppm
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663925, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:45.196383 24493 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:38:45.196842 24493 webserver.cc:460] Webserver started at http://127.15.157.131:44147/ using document root <none> and password file <none>
I20260929 06:38:45.197074 24493 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:45.197141 24493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:45.197286 24493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:45.198484 24493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "75a26733ec9a4adfa50e68e8d93ce9b9"
format_stamp: "Formatted at 2026-09-29 06:38:45 on dist-test-slave-ltw5"
server_key: "f28cd2f215cb4b8e20cf7632c4c28562"
server_key_iv: "63dc9911e87a41c740f87684cabda1fc"
server_key_version: "encryptionkey@0"
I20260929 06:38:45.198885 24493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "75a26733ec9a4adfa50e68e8d93ce9b9"
format_stamp: "Formatted at 2026-09-29 06:38:45 on dist-test-slave-ltw5"
server_key: "f28cd2f215cb4b8e20cf7632c4c28562"
server_key_iv: "63dc9911e87a41c740f87684cabda1fc"
server_key_version: "encryptionkey@0"
I20260929 06:38:45.200268 24493 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:45.200989 24508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.201167 24493 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:45.201280 24493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "75a26733ec9a4adfa50e68e8d93ce9b9"
format_stamp: "Formatted at 2026-09-29 06:38:45 on dist-test-slave-ltw5"
server_key: "f28cd2f215cb4b8e20cf7632c4c28562"
server_key_iv: "63dc9911e87a41c740f87684cabda1fc"
server_key_version: "encryptionkey@0"
I20260929 06:38:45.201354 24493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:45.212332 24493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:45.214205 24493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:45.214366 24493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:45.214600 24493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:45.214910 24493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:45.214963 24493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.215003 24493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:45.215031 24493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.220976 24493 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:45299
I20260929 06:38:45.221024 24621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:45299 every 8 connection(s)
I20260929 06:38:45.221447 24493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663925, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:38:45.230223 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 24493
I20260929 06:38:45.230341 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:38:45.230543 15990 external_mini_cluster.cc:1428] Setting key d8a6f8d83fe161a40ae55c18eee8af48
I20260929 06:38:45.232462 24222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:45.222589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:46441 (local address 127.15.157.190:45293)
0929 06:38:45.222660 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:45.222662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:45.222675 (+ 13us) server_negotiation.cc:407] Connection header received
0929 06:38:45.223292 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:45.223293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:45.223305 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:45.223383 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:45.224293 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.225006 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.225963 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.226267 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.226336 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.228970 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:45.228972 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:45.228972 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:45.228980 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:45.230752 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:45.231315 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:45.231316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:45.231316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:45.231378 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:45.231650 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:45.231651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:45.231651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:45.231837 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:45.231933 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:45.232267 (+ 334us) server_negotiation.cc:299] Negotiation successful
0929 06:38:45.232344 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 06:38:45.232627 24624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:45.222319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:46441)
0929 06:38:45.222481 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:45.222523 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:45.223190 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:45.223437 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:45.223441 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:45.224006 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:45.224201 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.224206 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.225094 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.225095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.225881 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.225883 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.226401 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.226402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.226547 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.227122 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:45.227132 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:45.228866 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:45.230913 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:45.230920 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:45.230923 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:45.231225 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:45.231448 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:45.231449 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:45.231449 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:45.231566 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:45.231939 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:45.231944 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:45.232101 (+ 157us) client_negotiation.cc:769] Sending connection context
0929 06:38:45.232216 (+ 115us) client_negotiation.cc:240] Negotiation successful
0929 06:38:45.232376 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":93,"threads_started":1}
I20260929 06:38:45.233812 24622 heartbeater.cc:347] Connected to a master server at 127.15.157.190:45293
I20260929 06:38:45.233924 24622 heartbeater.cc:464] Registering TS with master...
I20260929 06:38:45.234129 24622 heartbeater.cc:511] Master 127.15.157.190:45293 requested a full tablet report, sending...
I20260929 06:38:45.234530 24163 ts_manager.cc:194] Registered new tserver with Master: 75a26733ec9a4adfa50e68e8d93ce9b9 (127.15.157.131:45299)
I20260929 06:38:45.234896 24163 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:46441
I20260929 06:38:45.241978 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.129.keytab.
Entry for principal oryx/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.129.keytab.
WARNING: no policy specified for oryx/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.130.keytab.
Entry for principal oryx/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.130.keytab.
WARNING: no policy specified for oryx/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.131.keytab.
Entry for principal oryx/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.131.keytab.
I20260929 06:38:45.313001 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 24225
I20260929 06:38:45.317408 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 24359
I20260929 06:38:45.321638 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 24493
I20260929 06:38:45.325968 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 24131
I20260929 06:38:45.330945 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45293
--webserver_interface=127.15.157.190
--webserver_port=43955
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:45293
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:45.410274 24631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:45.410526 24631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:45.410562 24631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:45.411733 24631 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:45.411813 24631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:45.411835 24631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:45.411856 24631 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:45.411886 24631 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:45.413362 24631 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:45293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=43955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:45.413650 24631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:45.413877 24631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:45.418895 24639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:45.418927 24631 server_base.cc:1034] running on GCE node
W20260929 06:38:45.418993 24636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:45.419183 24637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:45.419454 24631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:45.419741 24631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:45.420907 24631 hybrid_clock.cc:648] HybridClock initialized: now 1790663925420903 us; error 42 us; skew 500 ppm
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663925, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:45.423298 24631 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:38:45.423710 24631 webserver.cc:460] Webserver started at http://127.15.157.190:43955/ using document root <none> and password file <none>
I20260929 06:38:45.423942 24631 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:45.424021 24631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:45.425328 24631 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:45.425930 24646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.426102 24631 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:45.426213 24631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "bd02f1b6e07a4deca106707f8ac50a85"
format_stamp: "Formatted at 2026-09-29 06:38:44 on dist-test-slave-ltw5"
server_key: "b9e2db952e7e1973602bccd23e162b96"
server_key_iv: "c20fbe1b74ac3da2a0b67c0dd5e0a29c"
server_key_version: "encryptionkey@0"
I20260929 06:38:45.426544 24631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:45.438726 24631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:45.440421 24631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:45.440582 24631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:45.444388 24631 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:45293
I20260929 06:38:45.444440 24698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:45293 every 8 connection(s)
I20260929 06:38:45.444826 24631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:45.445266 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 24631
I20260929 06:38:45.445592 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:44805
--local_ip_for_outbound_sockets=127.15.157.129
--tserver_master_addrs=127.15.157.190:45293
--webserver_port=42221
--webserver_interface=127.15.157.129
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.157.129
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:38:45.447093 24699 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:38:45.447719 24699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85: Bootstrap starting.
I20260929 06:38:45.455597 24699 log.cc:824] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:45.457245 24699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:38:45.457531 24699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85: Bootstrap complete.
I20260929 06:38:45.459854 24699 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd02f1b6e07a4deca106707f8ac50a85" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45293 } }
I20260929 06:38:45.460094 24699 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd02f1b6e07a4deca106707f8ac50a85, State: Initialized, Role: FOLLOWER
I20260929 06:38:45.460282 24699 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd02f1b6e07a4deca106707f8ac50a85" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45293 } }
I20260929 06:38:45.460358 24699 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:45.460410 24699 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:45.460458 24699 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 1 FOLLOWER]: Advancing to term 2
I20260929 06:38:45.461597 24699 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd02f1b6e07a4deca106707f8ac50a85" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45293 } }
I20260929 06:38:45.461714 24699 leader_election.cc:302] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd02f1b6e07a4deca106707f8ac50a85; no voters:
I20260929 06:38:45.461915 24699 leader_election.cc:288] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 06:38:45.461949 24703 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 06:38:45.462090 24703 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [term 2 LEADER]: Becoming Leader. State: Replica: bd02f1b6e07a4deca106707f8ac50a85, State: Running, Role: LEADER
I20260929 06:38:45.462175 24703 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd02f1b6e07a4deca106707f8ac50a85" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45293 } }
I20260929 06:38:45.462208 24699 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:45.462440 24703 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd02f1b6e07a4deca106707f8ac50a85. Latest consensus state: current_term: 2 leader_uuid: "bd02f1b6e07a4deca106707f8ac50a85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd02f1b6e07a4deca106707f8ac50a85" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45293 } } }
I20260929 06:38:45.462510 24703 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:45.462442 24705 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "bd02f1b6e07a4deca106707f8ac50a85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd02f1b6e07a4deca106707f8ac50a85" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45293 } } }
I20260929 06:38:45.462553 24705 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:45.463874 24719 catalog_manager.cc:1259] Loaded cluster ID: e06e1835e6cf4889a330b6ee2ba4bf52
I20260929 06:38:45.463943 24719 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85: loading cluster ID for follower catalog manager: success
I20260929 06:38:45.464725 24719 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85: acquiring CA information for follower catalog manager: success
I20260929 06:38:45.465024 24719 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:38:45.465114 24707 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:45.465281 24707 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:45.465359 24707 catalog_manager.cc:1259] Loaded cluster ID: e06e1835e6cf4889a330b6ee2ba4bf52
I20260929 06:38:45.465392 24707 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:45.465538 24707 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:45.465654 24707 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bd02f1b6e07a4deca106707f8ac50a85: Loaded TSK: 0
I20260929 06:38:45.465827 24707 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 06:38:45.544044 24701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:45.544246 24701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:45.544269 24701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:45.545419 24701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:45.545459 24701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:45.545485 24701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:38:45.546916 24701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.129.keytab
--principal=oryx/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:44805
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=42221
--tserver_master_addrs=127.15.157.190:45293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:45.547150 24701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:45.547384 24701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:45.552168 24725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:45.552230 24728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:45.552338 24726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:45.552335 24701 server_base.cc:1034] running on GCE node
I20260929 06:38:45.552584 24701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:45.552814 24701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:45.553973 24701 hybrid_clock.cc:648] HybridClock initialized: now 1790663925553953 us; error 45 us; skew 500 ppm
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663925, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:45.556607 24701 init.cc:377] Logged in from keytab as oryx/127.15.157.129@KRBTEST.COM (short username oryx)
I20260929 06:38:45.557114 24701 webserver.cc:460] Webserver started at http://127.15.157.129:42221/ using document root <none> and password file <none>
I20260929 06:38:45.557381 24701 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:45.557461 24701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:45.559249 24701 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:45.559900 24735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.560117 24701 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:38:45.560212 24701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "41e690f759bc4bf08d393ae8c3c7883d"
format_stamp: "Formatted at 2026-09-29 06:38:44 on dist-test-slave-ltw5"
server_key: "679da8646495f12ea986bfcbbea3d6b4"
server_key_iv: "3e16aa85fb7226e3ba5095a4241c9e48"
server_key_version: "encryptionkey@0"
I20260929 06:38:45.560635 24701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:45.598946 24701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:45.601378 24701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:45.601541 24701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:45.601821 24701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:45.602205 24701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:45.602258 24701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.602290 24701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:45.602308 24701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.609300 24701 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:44805
I20260929 06:38:45.609388 24848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:44805 every 8 connection(s)
I20260929 06:38:45.609719 24701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:38:45.611159 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 24701
I20260929 06:38:45.611460 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:34091
--local_ip_for_outbound_sockets=127.15.157.130
--tserver_master_addrs=127.15.157.190:45293
--webserver_port=33321
--webserver_interface=127.15.157.130
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.157.130
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:45.620290 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:45.610399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:45493)
0929 06:38:45.610595 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:45.610641 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:45.611241 (+ 600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:45.611824 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:45.611828 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:45.612643 (+ 815us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:45.612942 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.612955 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.614063 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.614064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.615380 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.615383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.616319 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.616321 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.616483 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.617151 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:45.617161 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:45.620059 (+ 2898us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":108,"threads_started":1}
W20260929 06:38:45.620528 24849 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:45293 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.157.190:45293: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
W20260929 06:38:45.620642 24852 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:45.610523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:45493 (local address 127.15.157.190:45293)
0929 06:38:45.610723 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:45.610730 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:45.610760 (+ 30us) server_negotiation.cc:407] Connection header received
0929 06:38:45.611454 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:45.611461 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:45.611522 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:45.611657 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:45.613067 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.613935 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.615497 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.616215 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.616342 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.620203 (+ 3861us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:45493: BlockingRecv error: recv got EOF from 127.15.157.129:45493 (error 108)
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":74,"threads_started":1}
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:45.626132 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:45.620758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:44777)
0929 06:38:45.620992 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:45.621004 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:45.621059 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:45.621197 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:45.621198 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:45.621356 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:45.621409 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.621410 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.622318 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.622319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.623206 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.623208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.623650 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.623651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.623719 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.624191 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:45.624196 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:45.626069 (+ 1873us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":77,"threads_started":1}
W20260929 06:38:45.626487 24852 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:45.620927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:44777 (local address 127.15.157.190:45293)
0929 06:38:45.620985 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:45.620987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:45.621055 (+ 68us) server_negotiation.cc:407] Connection header received
0929 06:38:45.621122 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:45.621122 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:45.621134 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:45.621193 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:45.621481 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.622238 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.623286 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.623581 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.623643 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.626436 (+ 2793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:44777: BlockingRecv error: recv got EOF from 127.15.157.129:44777 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:45.631327 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:45.626527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:42687)
0929 06:38:45.626740 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:45.626749 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:45.626796 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:45.626930 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:45.626931 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:45.627064 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:45.627094 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.627095 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.627888 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.627888 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.628682 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.628683 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.629072 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.629073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.629136 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.629483 (+ 347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:45.629488 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:45.631250 (+ 1762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199}
W20260929 06:38:45.631381 24852 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:45.626604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:42687 (local address 127.15.157.190:45293)
0929 06:38:45.626671 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:45.626673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:45.626802 (+ 129us) server_negotiation.cc:407] Connection header received
0929 06:38:45.626846 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:45.626847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:45.626857 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:45.626916 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:45.627168 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.627816 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.628784 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.628973 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.629069 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.631315 (+ 2246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:42687: BlockingRecv error: recv got EOF from 127.15.157.129:42687 (error 108)
Metrics: {"server-negotiator.queue_time_us":52,"thread_start_us":86,"threads_started":1}
W20260929 06:38:45.631460 24849 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 06:38:45.695837 24853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:45.696026 24853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:45.696048 24853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:45.697211 24853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:45.697250 24853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:45.697275 24853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:38:45.698683 24853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.130.keytab
--principal=oryx/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:34091
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=33321
--tserver_master_addrs=127.15.157.190:45293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:45.698920 24853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:45.699141 24853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:45.704022 24860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:45.704073 24863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:45.704010 24861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:45.704272 24853 server_base.cc:1034] running on GCE node
I20260929 06:38:45.704471 24853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:45.704700 24853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:45.705835 24853 hybrid_clock.cc:648] HybridClock initialized: now 1790663925705823 us; error 27 us; skew 500 ppm
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663925, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:45.708308 24853 init.cc:377] Logged in from keytab as oryx/127.15.157.130@KRBTEST.COM (short username oryx)
I20260929 06:38:45.708760 24853 webserver.cc:460] Webserver started at http://127.15.157.130:33321/ using document root <none> and password file <none>
I20260929 06:38:45.708988 24853 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:45.709043 24853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:45.710420 24853 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:45.710963 24870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.711138 24853 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.711246 24853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "b8daf34f991144af84d4f88d0b6d43eb"
format_stamp: "Formatted at 2026-09-29 06:38:45 on dist-test-slave-ltw5"
server_key: "551c44d185a94031430abeae0c46d97f"
server_key_iv: "314297aaf56109750c756c56e1448b46"
server_key_version: "encryptionkey@0"
I20260929 06:38:45.711565 24853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:45.731456 24853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:45.733747 24853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:45.733908 24853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:45.734192 24853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:45.734494 24853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:45.734547 24853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.734582 24853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:45.734608 24853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.740334 24853 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:34091
I20260929 06:38:45.740381 24983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:34091 every 8 connection(s)
I20260929 06:38:45.740701 24853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
W20260929 06:38:45.747308 24852 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:45.741358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:50337 (local address 127.15.157.190:45293)
0929 06:38:45.741397 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:45.741398 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:45.741613 (+ 215us) server_negotiation.cc:407] Connection header received
0929 06:38:45.742128 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:45.742129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:45.742142 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:45.742208 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:45.743067 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.743536 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.744461 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.744629 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.744676 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.747250 (+ 2574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:50337: BlockingRecv error: recv got EOF from 127.15.157.130:50337 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:38:45.747334 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 24853
I20260929 06:38:45.747378 24986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:45.741359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:50337)
0929 06:38:45.741497 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:45.741529 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:45.741985 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:45.742265 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:45.742269 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:45.742814 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:45.742994 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.742998 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.743608 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.743609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.744392 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.744393 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.744699 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.744700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.744797 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.745201 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:45.745209 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:45.747190 (+ 1981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":82,"threads_started":1}
W20260929 06:38:45.747618 24984 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:45293 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.157.190:45293: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
I20260929 06:38:45.747637 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:45299
--local_ip_for_outbound_sockets=127.15.157.131
--tserver_master_addrs=127.15.157.190:45293
--webserver_port=44147
--webserver_interface=127.15.157.131
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.157.131
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:45.752146 24986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:45.747965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:47001)
0929 06:38:45.748015 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:45.748025 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:45.748062 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:45.748212 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:45.748213 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:45.748333 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:45.748369 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.748370 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.749102 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.749103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.749593 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.749595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.749965 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.749966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.750050 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.750452 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:45.750457 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:45.752068 (+ 1611us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 06:38:45.752206 24852 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:45.748023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:47001 (local address 127.15.157.190:45293)
0929 06:38:45.748068 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:45.748070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:45.748094 (+ 24us) server_negotiation.cc:407] Connection header received
0929 06:38:45.748114 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:45.748115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:45.748123 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:45.748207 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:45.748450 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.749010 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.749692 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.749883 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.749965 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.752130 (+ 2165us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:47001: BlockingRecv error: recv got EOF from 127.15.157.130:47001 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:45.756696 24986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:45.752473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:34983)
0929 06:38:45.752517 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:45.752529 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:45.752565 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:45.752715 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:45.752715 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:45.752811 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:45.752833 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.752834 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.753749 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.753749 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.754263 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.754264 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.754747 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.754748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.754781 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.755158 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:45.755173 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:45.756649 (+ 1476us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260929 06:38:45.756847 24852 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:45.752543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:34983 (local address 127.15.157.190:45293)
0929 06:38:45.752595 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:45.752598 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:45.752606 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:45.752627 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:45.752628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:45.752638 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:45.752715 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:45.752897 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.753663 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.754345 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.754671 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.754754 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.756764 (+ 2010us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:34983: BlockingRecv error: recv got EOF from 127.15.157.130:34983 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260929 06:38:45.757004 24984 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 06:38:45.828063 24987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:45.828258 24987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:45.828280 24987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:45.829423 24987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:45.829468 24987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:45.829527 24987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:38:45.830998 24987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/krb5kdc/oryx_127.15.157.131.keytab
--principal=oryx/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:45299
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=44147
--tserver_master_addrs=127.15.157.190:45293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:45.831179 24987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:45.831338 24987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:45.836175 24993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:45.836192 24992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:45.836213 24995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:45.836380 24987 server_base.cc:1034] running on GCE node
I20260929 06:38:45.836570 24987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:45.836812 24987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:45.837947 24987 hybrid_clock.cc:648] HybridClock initialized: now 1790663925837916 us; error 43 us; skew 500 ppm
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663925, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:45.840358 24987 init.cc:377] Logged in from keytab as oryx/127.15.157.131@KRBTEST.COM (short username oryx)
I20260929 06:38:45.840775 24987 webserver.cc:460] Webserver started at http://127.15.157.131:44147/ using document root <none> and password file <none>
I20260929 06:38:45.840996 24987 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:45.841071 24987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:45.842449 24987 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:38:45.842960 25002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.843108 24987 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:38:45.843218 24987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "75a26733ec9a4adfa50e68e8d93ce9b9"
format_stamp: "Formatted at 2026-09-29 06:38:45 on dist-test-slave-ltw5"
server_key: "f28cd2f215cb4b8e20cf7632c4c28562"
server_key_iv: "63dc9911e87a41c740f87684cabda1fc"
server_key_version: "encryptionkey@0"
I20260929 06:38:45.843541 24987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:45.869760 24987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:45.871778 24987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:45.871953 24987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:45.872197 24987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:38:45.872516 24987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:38:45.872577 24987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.872611 24987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:38:45.872637 24987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:45.878317 24987 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:45299
I20260929 06:38:45.878400 25115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:45299 every 8 connection(s)
I20260929 06:38:45.878760 24987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:38:45.882270 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 24987
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
W20260929 06:38:45.886507 24852 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:45.879511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:36581 (local address 127.15.157.190:45293)
0929 06:38:45.879561 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:45.879564 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:45.879752 (+ 188us) server_negotiation.cc:407] Connection header received
0929 06:38:45.880281 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:45.880282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:45.880294 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:45.880349 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:45.881305 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.881797 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.883024 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.883242 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.883333 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.886459 (+ 3126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:36581: BlockingRecv error: recv got EOF from 127.15.157.131:36581 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:38:45.886608 25118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:45.879469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:36581)
0929 06:38:45.879608 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:45.879658 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:45.880169 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:45.880430 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:45.880434 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:45.881008 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:45.881199 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.881203 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.881895 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.881897 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.882932 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.882934 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.883342 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.883343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.883477 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.883976 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:45.883983 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:45.886391 (+ 2408us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":67,"threads_started":1}
W20260929 06:38:45.886941 25116 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:45293 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.157.190:45293: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:45.890313 24855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:45.882754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35420 (local address 127.15.157.190:45293)
0929 06:38:45.882834 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:45.882836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:45.882847 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:38:45.882915 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:45.882916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:45.882927 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:45.883010 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:45.883598 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.884193 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.885284 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.885593 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.885669 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.887080 (+ 1411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:45.887084 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:45.887085 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:45.887096 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:45.888780 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:45.889161 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:45.889164 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:45.889165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:45.889267 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:45.889521 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:45.889522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:45.889523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:45.889757 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:45.889855 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:45.890069 (+ 214us) server_negotiation.cc:299] Negotiation successful
0929 06:38:45.890167 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:45.891443 25118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:45.887164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:46889)
0929 06:38:45.887211 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:45.887221 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:45.887262 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:45.887388 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:45.887388 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:45.887545 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:45.887590 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.887591 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.888232 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.888233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.888752 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.888754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.889113 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.889113 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.889184 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.889549 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:45.889554 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:45.891400 (+ 1846us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 06:38:45.891496 24852 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:45.887211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:46889 (local address 127.15.157.190:45293)
0929 06:38:45.887251 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:45.887253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:45.887262 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:45.887321 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:45.887321 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:45.887330 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:45.887383 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:45.887700 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.888134 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.888836 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.889031 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.889112 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.891462 (+ 2350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:46889: BlockingRecv error: recv got EOF from 127.15.157.131:46889 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:45 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:45.895545 25118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:45.891728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:52581)
0929 06:38:45.891769 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:45.891778 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:45.891812 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:45.891916 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:45.891916 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:45.892040 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:45.892064 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.892065 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.892646 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.892647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.893124 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:45.893126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.893505 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.893506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:45.893556 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.893952 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:45.893957 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:45.895452 (+ 1495us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260929 06:38:45.895588 24852 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:45.891788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:52581 (local address 127.15.157.190:45293)
0929 06:38:45.891823 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:45.891825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:45.891832 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:45.891863 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:45.891864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:45.891871 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:45.891914 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:45.892142 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.892569 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.893224 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:45.893420 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:45.893503 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:45.895528 (+ 2025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:52581: BlockingRecv error: recv got EOF from 127.15.157.131:52581 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260929 06:38:45.895710 25116 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 29 06:38:46 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:46 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:46.642987 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:46.631837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:43139)
0929 06:38:46.631992 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:46.632004 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:46.632066 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:46.632206 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:46.632206 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:46.632385 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:46.632431 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:46.632432 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:46.633149 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:46.633150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:46.633805 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:46.633807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:46.634224 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:46.634224 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:46.634265 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:46.641014 (+ 6749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:46.641019 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:46.642920 (+ 1901us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":89,"threads_started":1}
W20260929 06:38:46.643148 25121 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:46.631938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:43139 (local address 127.15.157.190:45293)
0929 06:38:46.632077 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:46.632079 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:46.632087 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:46.632110 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:46.632110 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:46.632119 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:46.632187 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:46.632532 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:46.633067 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:46.633894 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:46.634160 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:46.634217 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:46.643048 (+ 8831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:43139: BlockingRecv error: recv got EOF from 127.15.157.129:43139 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":88,"threads_started":1}
Sep 29 06:38:46 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:46 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:46.761621 25122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:46.757327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:45709)
0929 06:38:46.757436 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:46.757446 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:46.757495 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:46.757611 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:46.757612 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:46.757759 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:46.757803 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:46.757805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:46.758421 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:46.758421 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:46.758989 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:46.758991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:46.759290 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:46.759291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:46.759327 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:46.759766 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:46.759770 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:46.761519 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":52,"threads_started":1}
W20260929 06:38:46.761694 25121 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:46.757387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:45709 (local address 127.15.157.190:45293)
0929 06:38:46.757466 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:46.757468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:46.757479 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:38:46.757546 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:46.757546 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:46.757557 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:46.757596 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:46.757866 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:46.758360 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:46.759057 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:46.759233 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:46.759283 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:46.761618 (+ 2335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:45709: BlockingRecv error: recv got EOF from 127.15.157.130:45709 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Sep 29 06:38:46 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:46 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:46.901249 25123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:46.896188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:45581)
0929 06:38:46.896360 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:46.896379 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:46.896486 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:46.896629 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:46.896629 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:46.896805 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:46.896865 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:46.896867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:46.897776 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:46.897777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:46.898434 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:46.898437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:46.898806 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:46.898807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:46.898862 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:46.899362 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:46.899368 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:46.901142 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":90,"threads_started":1}
W20260929 06:38:46.901280 25121 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:46.896313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:45581 (local address 127.15.157.190:45293)
0929 06:38:46.896397 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:46.896399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:46.896433 (+ 34us) server_negotiation.cc:407] Connection header received
0929 06:38:46.896552 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:46.896553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:46.896566 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:46.896622 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:46.897031 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:46.897690 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:46.898525 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:46.898726 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:46.898809 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:46.901218 (+ 2409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:45581: BlockingRecv error: recv got EOF from 127.15.157.131:45581 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Sep 29 06:38:47 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:47 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:47.647930 25124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:47.643435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:37011)
0929 06:38:47.643559 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:47.643577 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:47.643626 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:47.643752 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:47.643752 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:47.643907 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:47.643956 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:47.643957 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:47.644576 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:47.644577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:47.645111 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:47.645113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:47.645431 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:47.645432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:47.645471 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:47.646110 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:47.646114 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:47.647870 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":79,"threads_started":1}
W20260929 06:38:47.648037 25125 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:47.643483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:37011 (local address 127.15.157.190:45293)
0929 06:38:47.643607 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:47.643609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:47.643616 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:47.643669 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:47.643669 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:47.643679 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:47.643740 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:47.644012 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:47.644495 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:47.645183 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:47.645371 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:47.645420 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:47.647961 (+ 2541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:37011: BlockingRecv error: recv got EOF from 127.15.157.129:37011 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":73,"threads_started":1}
Sep 29 06:38:47 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:47 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:47.766716 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:47.762199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:44191)
0929 06:38:47.762299 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:47.762316 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:47.762369 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:47.762494 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:47.762494 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:47.762645 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:47.762692 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:47.762694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:47.763398 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:47.763399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:47.763961 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:47.763963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:47.764321 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:47.764322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:47.764379 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:47.764835 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:47.764839 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:47.766657 (+ 1818us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":58,"threads_started":1}
W20260929 06:38:47.766827 25125 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:47.762242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:44191 (local address 127.15.157.190:45293)
0929 06:38:47.762286 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:47.762288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:47.762368 (+ 80us) server_negotiation.cc:407] Connection header received
0929 06:38:47.762420 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:47.762420 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:47.762431 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:47.762478 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:47.762749 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:47.763335 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:47.764028 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:47.764252 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:47.764313 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:47.766753 (+ 2440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:44191: BlockingRecv error: recv got EOF from 127.15.157.130:44191 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Sep 29 06:38:47 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:47 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:47.906335 25127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:47.901805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:40201)
0929 06:38:47.901939 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:47.901965 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:47.902046 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:47.902207 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:47.902208 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:47.902387 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:47.902432 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:47.902434 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:47.903101 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:47.903102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:47.903627 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:47.903629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:47.903998 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:47.903999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:47.904060 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:47.904494 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:47.904498 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:47.906236 (+ 1738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":71,"threads_started":1}
W20260929 06:38:47.906385 25125 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:47.901926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:40201 (local address 127.15.157.190:45293)
0929 06:38:47.901994 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:47.901997 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:47.902010 (+ 13us) server_negotiation.cc:407] Connection header received
0929 06:38:47.902131 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:47.902132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:47.902147 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:47.902203 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:47.902507 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:47.903002 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:47.903719 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:47.903910 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:47.903996 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:47.906319 (+ 2323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:40201: BlockingRecv error: recv got EOF from 127.15.157.131:40201 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Sep 29 06:38:48 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:48 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:48.653960 25128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:48.648522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:57405)
0929 06:38:48.648661 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:48.648673 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:48.648730 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:48.648915 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:48.648916 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:48.649143 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:48.649205 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:48.649207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:48.649974 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:48.649976 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:48.650977 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:48.650980 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:48.651340 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:48.651342 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:48.651411 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:48.651859 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:48.651866 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:48.653866 (+ 2000us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":64,"threads_started":1}
W20260929 06:38:48.654004 25129 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:48.648621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:57405 (local address 127.15.157.190:45293)
0929 06:38:48.648769 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:48.648771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:48.648786 (+ 15us) server_negotiation.cc:407] Connection header received
0929 06:38:48.648807 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:48.648807 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:48.648818 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:48.648880 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:48.649307 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:48.649887 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:48.651071 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:48.651262 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:48.651318 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:48.653939 (+ 2621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:57405: BlockingRecv error: recv got EOF from 127.15.157.129:57405 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":103,"threads_started":1}
Sep 29 06:38:48 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:48 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:48.771494 25130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:48.767227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:59251)
0929 06:38:48.767374 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:48.767384 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:48.767448 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:48.767566 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:48.767567 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:48.767723 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:48.767769 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:48.767770 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:48.768360 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:48.768361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:48.768880 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:48.768881 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:48.769182 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:48.769183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:48.769221 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:48.769725 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:48.769730 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:48.771439 (+ 1709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":87,"threads_started":1}
W20260929 06:38:48.771633 25129 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:48.767271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:59251 (local address 127.15.157.190:45293)
0929 06:38:48.767332 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:48.767334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:48.767446 (+ 112us) server_negotiation.cc:407] Connection header received
0929 06:38:48.767493 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:48.767493 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:48.767504 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:48.767551 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:48.767825 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:48.768299 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:48.768947 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:48.769123 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:48.769172 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:48.771521 (+ 2349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:59251: BlockingRecv error: recv got EOF from 127.15.157.130:59251 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Sep 29 06:38:48 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:48 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:48.911476 25131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:48.906883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:37803)
0929 06:38:48.907042 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:48.907053 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:48.907112 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:48.907246 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:48.907246 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:48.907397 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:48.907446 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:48.907447 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:48.908054 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:48.908055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:48.908580 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:48.908582 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:48.908966 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:48.908967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:48.909017 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:48.909462 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:48.909467 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:48.911417 (+ 1950us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
W20260929 06:38:48.911579 25129 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:48.906940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:37803 (local address 127.15.157.190:45293)
0929 06:38:48.907009 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:48.907011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:48.907114 (+ 103us) server_negotiation.cc:407] Connection header received
0929 06:38:48.907169 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:48.907170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:48.907187 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:48.907234 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:48.907500 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:48.907983 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:48.908677 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:48.908862 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:48.908926 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:48.911512 (+ 2586us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:37803: BlockingRecv error: recv got EOF from 127.15.157.131:37803 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Sep 29 06:38:49 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:49 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:49.659121 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:49.654535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:45227)
0929 06:38:49.654661 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:49.654678 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:49.654727 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:49.654858 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:49.654859 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:49.655021 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:49.655069 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:49.655070 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:49.655719 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:49.655720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:49.656324 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:49.656325 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:49.656702 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:49.656703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:49.656755 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:49.657260 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:49.657265 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:49.659062 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":75,"threads_started":1}
W20260929 06:38:49.659240 25133 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:49.654614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:45227 (local address 127.15.157.190:45293)
0929 06:38:49.654735 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:49.654742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:49.654749 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:49.654771 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:49.654771 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:49.654781 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:49.654841 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:49.655138 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:49.655642 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:49.656387 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:49.656626 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:49.656695 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:49.659158 (+ 2463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:45227: BlockingRecv error: recv got EOF from 127.15.157.129:45227 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":71,"threads_started":1}
Sep 29 06:38:49 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:49 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:49.776235 25134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:49.771919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:57915)
0929 06:38:49.772081 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:49.772091 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:49.772149 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:49.772293 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:49.772294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:49.772447 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:49.772494 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:49.772496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:49.773133 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:49.773134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:49.773644 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:49.773645 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:49.773947 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:49.773948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:49.773984 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:49.774461 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:49.774465 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:49.776180 (+ 1715us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":82,"threads_started":1}
W20260929 06:38:49.776371 25133 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:49.771983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:57915 (local address 127.15.157.190:45293)
0929 06:38:49.772069 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:49.772071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:49.772146 (+ 75us) server_negotiation.cc:407] Connection header received
0929 06:38:49.772213 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:49.772213 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:49.772224 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:49.772269 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:49.772559 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:49.773053 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:49.773709 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:49.773885 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:49.773937 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:49.776289 (+ 2352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:57915: BlockingRecv error: recv got EOF from 127.15.157.130:57915 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Sep 29 06:38:49 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:49 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:49.916697 25135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:49.912047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:44921)
0929 06:38:49.912205 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:49.912217 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:49.912286 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:49.912442 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:49.912443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:49.912599 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:49.912650 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:49.912652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:49.913283 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:49.913284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:49.913868 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:49.913869 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:49.914288 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:49.914289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:49.914331 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:49.914865 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:49.914869 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:49.916639 (+ 1770us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":106,"threads_started":1}
W20260929 06:38:49.916787 25133 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:49.912175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:44921 (local address 127.15.157.190:45293)
0929 06:38:49.912244 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:49.912246 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:49.912271 (+ 25us) server_negotiation.cc:407] Connection header received
0929 06:38:49.912344 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:49.912344 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:49.912356 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:49.912420 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:49.912715 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:49.913212 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:49.913938 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:49.914221 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:49.914279 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:49.916723 (+ 2444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:44921: BlockingRecv error: recv got EOF from 127.15.157.131:44921 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Sep 29 06:38:50 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:50 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:50.664280 25136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:50.659614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:39791)
0929 06:38:50.659754 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:50.659765 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:50.659824 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:50.659960 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:50.659961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:50.660137 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:50.660184 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:50.660185 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:50.660806 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:50.660807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:50.661328 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:50.661329 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:50.661634 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:50.661634 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:50.661670 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:50.662220 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:50.662225 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:50.664185 (+ 1960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":82,"threads_started":1}
W20260929 06:38:50.664326 25137 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:50.659684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:39791 (local address 127.15.157.190:45293)
0929 06:38:50.659811 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:50.659813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:50.659826 (+ 13us) server_negotiation.cc:407] Connection header received
0929 06:38:50.659881 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:50.659881 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:50.659892 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:50.659942 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:50.660247 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:50.660741 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:50.661396 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:50.661575 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:50.661631 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:50.664258 (+ 2627us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:39791: BlockingRecv error: recv got EOF from 127.15.157.129:39791 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
Sep 29 06:38:50 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:50 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:50.781009 25138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:50.776693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:59709)
0929 06:38:50.776852 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:50.776863 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:50.776908 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:50.777024 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:50.777025 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:50.777192 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:50.777239 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:50.777240 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:50.777863 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:50.777865 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:50.778410 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:50.778411 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:50.778753 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:50.778754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:50.778793 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:50.779233 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:50.779238 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:50.780950 (+ 1712us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":94,"threads_started":1}
W20260929 06:38:50.781157 25137 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:50.776838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:59709 (local address 127.15.157.190:45293)
0929 06:38:50.776891 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:50.776893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:50.776901 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:50.776954 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:50.776955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:50.776966 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:50.777013 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:50.777301 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:50.777795 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:50.778492 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:50.778678 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:50.778739 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:50.781069 (+ 2330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:59709: BlockingRecv error: recv got EOF from 127.15.157.130:59709 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Sep 29 06:38:50 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:50 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:50.921568 25139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:50.917223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:56371)
0929 06:38:50.917372 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:50.917382 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:50.917437 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:50.917582 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:50.917583 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:50.917743 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:50.917790 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:50.917792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:50.918474 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:50.918475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:50.919003 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:50.919004 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:50.919310 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:50.919310 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:50.919348 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:50.919760 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:50.919764 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:50.921512 (+ 1748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":85,"threads_started":1}
W20260929 06:38:50.921684 25137 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:50.917323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:56371 (local address 127.15.157.190:45293)
0929 06:38:50.917386 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:50.917387 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:50.917423 (+ 36us) server_negotiation.cc:407] Connection header received
0929 06:38:50.917496 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:50.917497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:50.917508 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:50.917565 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:50.917874 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:50.918402 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:50.919071 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:50.919249 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:50.919298 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:50.921607 (+ 2309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:56371: BlockingRecv error: recv got EOF from 127.15.157.131:56371 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Sep 29 06:38:51 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:51 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:51.675163 25140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:51.664809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:41863)
0929 06:38:51.664954 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:51.664964 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:51.665021 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:51.665167 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:51.665168 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:51.665326 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:51.665371 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:51.665372 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:51.666065 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:51.666065 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:51.666586 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:51.666588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:51.666904 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:51.666905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:51.666947 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:51.673312 (+ 6365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:51.673317 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:51.675099 (+ 1782us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
W20260929 06:38:51.675285 25141 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:51.664852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:41863 (local address 127.15.157.190:45293)
0929 06:38:51.664977 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:51.664979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:51.665018 (+ 39us) server_negotiation.cc:407] Connection header received
0929 06:38:51.665072 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:51.665072 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:51.665091 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:51.665152 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:51.665432 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:51.665936 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:51.666660 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:51.666843 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:51.666896 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:51.675199 (+ 8303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:41863: BlockingRecv error: recv got EOF from 127.15.157.129:41863 (error 108)
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":71,"threads_started":1}
Sep 29 06:38:51 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:51 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:51.786072 25142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:51.781537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:42617)
0929 06:38:51.781690 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:51.781701 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:51.781762 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:51.781905 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:51.781906 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:51.782102 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:51.782151 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:51.782153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:51.782828 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:51.782829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:51.783362 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:51.783363 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:51.783718 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:51.783719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:51.783763 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:51.784201 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:51.784205 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:51.785967 (+ 1762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":89,"threads_started":1}
W20260929 06:38:51.786252 25141 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:51.781616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:42617 (local address 127.15.157.190:45293)
0929 06:38:51.781700 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:51.781704 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:51.781748 (+ 44us) server_negotiation.cc:407] Connection header received
0929 06:38:51.781809 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:51.781810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:51.781820 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:51.781877 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:51.782219 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:51.782717 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:51.783454 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:51.783648 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:51.783706 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:51.786172 (+ 2466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:42617: BlockingRecv error: recv got EOF from 127.15.157.130:42617 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Sep 29 06:38:51 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:51 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:51.926791 25143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:51.922119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:46089)
0929 06:38:51.922267 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:51.922279 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:51.922331 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:51.922554 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:51.922555 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:51.922740 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:51.922785 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:51.922787 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:51.923455 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:51.923456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:51.923984 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:51.923985 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:51.924357 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:51.924358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:51.924416 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:51.924886 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:51.924891 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:51.926696 (+ 1805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":80,"threads_started":1}
W20260929 06:38:51.926832 25141 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:51.922359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:46089 (local address 127.15.157.190:45293)
0929 06:38:51.922438 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:51.922440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:51.922447 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:51.922466 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:51.922466 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:51.922477 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:51.922545 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:51.922868 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:51.923359 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:51.924073 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:51.924270 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:51.924357 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:51.926770 (+ 2413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:46089: BlockingRecv error: recv got EOF from 127.15.157.131:46089 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Sep 29 06:38:52 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:52 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:52.681924 25144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:52.675659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:54211)
0929 06:38:52.675819 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:52.675833 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:52.675904 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:52.676115 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:52.676116 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:52.676267 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:52.676314 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:52.676315 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:52.677342 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:52.677343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:52.678260 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:52.678262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:52.678798 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:52.678804 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:52.678884 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:52.679464 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:52.679469 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:52.681837 (+ 2368us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":74,"threads_started":1}
W20260929 06:38:52.682154 25145 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:52.675843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:54211 (local address 127.15.157.190:45293)
0929 06:38:52.675966 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:52.675968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:52.675979 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:38:52.676005 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:52.676006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:52.676021 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:52.676103 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:52.676374 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:52.677246 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:52.678349 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:52.678699 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:52.678781 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:52.681965 (+ 3184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:54211: BlockingRecv error: recv got EOF from 127.15.157.129:54211 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":67,"threads_started":1}
Sep 29 06:38:52 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:52 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:52.791206 25146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:52.786511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:37623)
0929 06:38:52.786702 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:52.786713 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:52.786807 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:52.786980 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:52.786981 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:52.787156 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:52.787201 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:52.787203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:52.787854 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:52.787855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:52.788387 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:52.788389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:52.788763 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:52.788764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:52.788828 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:52.789274 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:52.789278 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:52.791114 (+ 1836us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":105,"threads_started":1}
W20260929 06:38:52.791244 25145 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:52.786620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:37623 (local address 127.15.157.190:45293)
0929 06:38:52.786700 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:52.786702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:52.786788 (+ 86us) server_negotiation.cc:407] Connection header received
0929 06:38:52.786893 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:52.786894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:52.786908 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:52.786972 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:52.787279 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:52.787768 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:52.788481 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:52.788676 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:52.788760 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:52.791185 (+ 2425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:37623: BlockingRecv error: recv got EOF from 127.15.157.130:37623 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Sep 29 06:38:52 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:52 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:52.932236 25147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:52.927337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:60675)
0929 06:38:52.927582 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:52.927593 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:52.927692 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:52.927857 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:52.927859 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:52.928032 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:52.928075 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:52.928077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:52.928761 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:52.928762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:52.929381 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:52.929383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:52.929742 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:52.929742 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:52.929800 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:52.930305 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:52.930310 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:52.932140 (+ 1830us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":72,"threads_started":1}
W20260929 06:38:52.932286 25145 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:52.927379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:60675 (local address 127.15.157.190:45293)
0929 06:38:52.927537 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:52.927539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:52.927670 (+ 131us) server_negotiation.cc:407] Connection header received
0929 06:38:52.927755 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:52.927755 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:52.927771 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:52.927836 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:52.928184 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:52.928670 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:52.929464 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:52.929656 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:52.929740 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:52.932223 (+ 2483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:60675: BlockingRecv error: recv got EOF from 127.15.157.131:60675 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
Sep 29 06:38:53 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:53 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:53.686611 25148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:53.682349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:48691)
0929 06:38:53.682476 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:53.682492 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:53.682536 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:53.682705 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:53.682706 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:53.682863 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:53.682911 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:53.682912 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:53.683539 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:53.683540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:53.684073 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:53.684074 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:53.684387 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:53.684388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:53.684426 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:53.684817 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:53.684821 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:53.686548 (+ 1727us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":74,"threads_started":1}
W20260929 06:38:53.686751 25149 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:53.682459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:48691 (local address 127.15.157.190:45293)
0929 06:38:53.682579 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:53.682581 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:53.682589 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:53.682617 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:53.682618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:53.682628 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:53.682686 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:53.682973 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:53.683468 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:53.684147 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:53.684326 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:53.684375 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:53.686662 (+ 2287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:48691: BlockingRecv error: recv got EOF from 127.15.157.129:48691 (error 108)
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":72,"threads_started":1}
Sep 29 06:38:53 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:53 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:53.796128 25150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:53.791749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:34491)
0929 06:38:53.791917 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:53.791926 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:53.791981 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:53.792112 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:53.792113 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:53.792263 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:53.792309 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:53.792310 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:53.793091 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:53.793092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:53.793607 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:53.793608 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:53.793950 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:53.793951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:53.793988 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:53.794469 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:53.794474 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:53.796071 (+ 1597us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":90,"threads_started":1}
W20260929 06:38:53.796271 25149 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:53.791825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:34491 (local address 127.15.157.190:45293)
0929 06:38:53.791905 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:53.791907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:53.791982 (+ 75us) server_negotiation.cc:407] Connection header received
0929 06:38:53.792025 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:53.792026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:53.792036 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:53.792097 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:53.792363 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:53.793026 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:53.793691 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:53.793883 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:53.793941 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:53.796188 (+ 2247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:34491: BlockingRecv error: recv got EOF from 127.15.157.130:34491 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Sep 29 06:38:53 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:53 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:53.937438 25151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:53.932741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:53999)
0929 06:38:53.932922 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:53.932933 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:53.933006 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:53.933174 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:53.933175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:53.933349 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:53.933395 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:53.933397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:53.934117 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:53.934119 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:53.934671 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:53.934673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:53.935038 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:53.935039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:53.935096 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:53.935598 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:53.935603 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:53.937330 (+ 1727us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":104,"threads_started":1}
W20260929 06:38:53.937472 25149 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:53.932817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:53999 (local address 127.15.157.190:45293)
0929 06:38:53.932902 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:53.932904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:53.933000 (+ 96us) server_negotiation.cc:407] Connection header received
0929 06:38:53.933082 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:53.933082 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:53.933101 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:53.933165 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:53.933476 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:53.933966 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:53.934761 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:53.934955 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:53.935037 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:53.937408 (+ 2371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:53999: BlockingRecv error: recv got EOF from 127.15.157.131:53999 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Sep 29 06:38:54 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:54 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:54.691655 25152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:54.687171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:37723)
0929 06:38:54.687290 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:54.687303 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:54.687362 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:54.687552 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:54.687553 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:54.687784 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:54.687835 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:54.687837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:54.688511 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:54.688512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:54.689026 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:54.689028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:54.689365 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:54.689366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:54.689404 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:54.689825 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:54.689829 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:54.691589 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":67,"threads_started":1}
W20260929 06:38:54.691757 25153 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:54.687226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:37723 (local address 127.15.157.190:45293)
0929 06:38:54.687361 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:54.687379 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:54.687389 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:38:54.687424 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:54.687425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:54.687438 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:54.687508 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:54.687943 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:54.688439 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:54.689109 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:54.689298 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:54.689354 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:54.691681 (+ 2327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:37723: BlockingRecv error: recv got EOF from 127.15.157.129:37723 (error 108)
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":79,"threads_started":1}
Sep 29 06:38:54 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:54 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:54.801285 25154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:54.796594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:52787)
0929 06:38:54.796809 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:54.796822 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:54.796894 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:54.797023 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:54.797024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:54.797215 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:54.797261 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:54.797263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:54.797935 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:54.797936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:54.798493 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:54.798494 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:54.798878 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:54.798879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:54.798935 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:54.799400 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:54.799404 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:54.801177 (+ 1773us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":104,"threads_started":1}
W20260929 06:38:54.801328 25153 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:54.796701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:52787 (local address 127.15.157.190:45293)
0929 06:38:54.796813 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:54.796815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:54.796874 (+ 59us) server_negotiation.cc:407] Connection header received
0929 06:38:54.796952 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:54.796953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:54.796965 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:54.797017 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:54.797345 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:54.797846 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:54.798602 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:54.798800 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:54.798880 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:54.801263 (+ 2383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:52787: BlockingRecv error: recv got EOF from 127.15.157.130:52787 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Sep 29 06:38:54 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:54 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:54.942560 25155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:54.937966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:52393)
0929 06:38:54.938129 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:54.938139 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:54.938201 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:54.938335 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:54.938335 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:54.938542 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:54.938585 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:54.938587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:54.939262 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:54.939263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:54.939796 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:54.939798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:54.940176 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:54.940177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:54.940234 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:54.940642 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:54.940646 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:54.942449 (+ 1803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":103,"threads_started":1}
W20260929 06:38:54.942589 25153 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:54.937994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:52393 (local address 127.15.157.190:45293)
0929 06:38:54.938063 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:54.938065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:54.938183 (+ 118us) server_negotiation.cc:407] Connection header received
0929 06:38:54.938259 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:54.938259 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:54.938273 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:54.938317 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:54.938667 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:54.939177 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:54.939880 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:54.940090 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:54.940174 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:54.942529 (+ 2355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:52393: BlockingRecv error: recv got EOF from 127.15.157.131:52393 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Sep 29 06:38:55 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:55 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:55.696732 25156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:55.692213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:46227)
0929 06:38:55.692350 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:55.692360 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:55.692407 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:55.692550 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:55.692551 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:55.692711 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:55.692757 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:55.692759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:55.693387 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:55.693388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:55.693900 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:55.693901 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:55.694270 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:55.694271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:55.694313 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:55.694776 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:55.694780 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:55.696675 (+ 1895us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
W20260929 06:38:55.696851 25157 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:55.692282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:46227 (local address 127.15.157.190:45293)
0929 06:38:55.692425 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:55.692427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:55.692436 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:55.692456 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:55.692456 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:55.692466 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:55.692533 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:55.692825 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:55.693319 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:55.693985 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:55.694205 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:55.694262 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:55.696771 (+ 2509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:46227: BlockingRecv error: recv got EOF from 127.15.157.129:46227 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":82,"threads_started":1}
Sep 29 06:38:55 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:55 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:55.806502 25158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:55.801964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:55587)
0929 06:38:55.802130 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:55.802143 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:55.802226 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:55.802377 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:55.802377 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:55.802550 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:55.802597 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:55.802599 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:55.803273 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:55.803274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:55.803800 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:55.803802 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:55.804142 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:55.804142 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:55.804182 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:55.804630 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:55.804634 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:55.806420 (+ 1786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":91,"threads_started":1}
W20260929 06:38:55.806638 25157 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:55.802098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:55587 (local address 127.15.157.190:45293)
0929 06:38:55.802180 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:55.802182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:55.802205 (+ 23us) server_negotiation.cc:407] Connection header received
0929 06:38:55.802287 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:55.802287 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:55.802298 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:55.802348 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:55.802681 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:55.803165 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:55.803886 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:55.804075 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:55.804131 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:55.806535 (+ 2404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:55587: BlockingRecv error: recv got EOF from 127.15.157.130:55587 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Sep 29 06:38:55 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:55 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:55.947678 25159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:55.943065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:40233)
0929 06:38:55.943189 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:55.943208 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:55.943292 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:55.943450 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:55.943451 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:55.943640 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:55.943685 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:55.943688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:55.944365 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:55.944366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:55.944899 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:55.944900 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:55.945261 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:55.945261 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:55.945322 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:55.945759 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:55.945763 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:55.947580 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":78,"threads_started":1}
W20260929 06:38:55.947727 25157 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:55.943190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:40233 (local address 127.15.157.190:45293)
0929 06:38:55.943274 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:55.943276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:55.943286 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:38:55.943347 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:55.943348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:55.943361 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:55.943430 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:55.943773 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:55.944270 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:55.944989 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:55.945186 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:55.945264 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:55.947662 (+ 2398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:40233: BlockingRecv error: recv got EOF from 127.15.157.131:40233 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Sep 29 06:38:56 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:56 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:56.707161 25160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:56.697220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:50793)
0929 06:38:56.697379 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:56.697395 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:56.697444 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:56.697589 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:56.697589 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:56.697753 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:56.697798 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:56.697800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:56.698458 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:56.698459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:56.699017 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:56.699019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:56.699362 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:56.699363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:56.699413 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:56.705136 (+ 5723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:56.705142 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:56.707095 (+ 1953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":101,"threads_started":1}
W20260929 06:38:56.707270 25161 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:56.697307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:50793 (local address 127.15.157.190:45293)
0929 06:38:56.697458 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:56.697460 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:56.697484 (+ 24us) server_negotiation.cc:407] Connection header received
0929 06:38:56.697504 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:56.697504 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:56.697514 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:56.697566 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:56.697865 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:56.698381 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:56.699097 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:56.699293 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:56.699345 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:56.707198 (+ 7853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:50793: BlockingRecv error: recv got EOF from 127.15.157.129:50793 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":93,"threads_started":1}
Sep 29 06:38:56 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:56 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:56.811648 25162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:56.806974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:45781)
0929 06:38:56.807164 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:56.807176 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:56.807263 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:56.807416 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:56.807417 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:56.807598 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:56.807641 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:56.807643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:56.808304 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:56.808306 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:56.808850 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:56.808852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:56.809239 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:56.809240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:56.809305 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:56.809809 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:56.809813 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:56.811542 (+ 1729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":104,"threads_started":1}
W20260929 06:38:56.811686 25161 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:56.807080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:45781 (local address 127.15.157.190:45293)
0929 06:38:56.807166 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:56.807168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:56.807249 (+ 81us) server_negotiation.cc:407] Connection header received
0929 06:38:56.807347 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:56.807348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:56.807359 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:56.807401 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:56.807723 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:56.808219 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:56.808937 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:56.809148 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:56.809239 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:56.811625 (+ 2386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:45781: BlockingRecv error: recv got EOF from 127.15.157.130:45781 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Sep 29 06:38:56 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:56 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:56.952543 25163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:56.948231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:51131)
0929 06:38:56.948378 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:56.948391 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:56.948465 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:56.948603 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:56.948604 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:56.948786 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:56.948832 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:56.948834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:56.949424 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:56.949424 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:56.949963 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:56.949964 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:56.950332 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:56.950333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:56.950376 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:56.950791 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:56.950795 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:56.952472 (+ 1677us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
W20260929 06:38:56.952740 25161 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:56.948338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:51131 (local address 127.15.157.190:45293)
0929 06:38:56.948397 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:56.948407 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:56.948449 (+ 42us) server_negotiation.cc:407] Connection header received
0929 06:38:56.948516 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:56.948516 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:56.948532 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:56.948587 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:56.948888 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:56.949362 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:56.950099 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:56.950273 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:56.950323 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:56.952660 (+ 2337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:51131: BlockingRecv error: recv got EOF from 127.15.157.131:51131 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Sep 29 06:38:57 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:57 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:57.712188 25164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:57.707732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:39661)
0929 06:38:57.707873 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:57.707884 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:57.707942 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:57.708093 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:57.708094 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:57.708255 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:57.708301 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:57.708303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:57.708930 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:57.708930 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:57.709441 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:57.709443 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:57.709764 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:57.709765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:57.709803 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:57.710362 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:57.710367 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:57.712131 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
W20260929 06:38:57.712345 25165 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:57.707816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:39661 (local address 127.15.157.190:45293)
0929 06:38:57.707955 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:57.707957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:57.707982 (+ 25us) server_negotiation.cc:407] Connection header received
0929 06:38:57.708002 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:57.708003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:57.708013 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:57.708071 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:57.708365 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:57.708854 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:57.709512 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:57.709703 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:57.709752 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:57.712260 (+ 2508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:39661: BlockingRecv error: recv got EOF from 127.15.157.129:39661 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":82,"threads_started":1}
Sep 29 06:38:57 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:57 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:57.817145 25166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:57.812343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:37631)
0929 06:38:57.812517 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:57.812529 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:57.812598 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:57.812747 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:57.812748 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:57.812936 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:57.812979 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:57.812980 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:57.813659 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:57.813660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:57.814299 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:57.814301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:57.814696 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:57.814697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:57.814751 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:57.815256 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:57.815264 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:57.817049 (+ 1785us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":104,"threads_started":1}
W20260929 06:38:57.817194 25165 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:57.812440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:37631 (local address 127.15.157.190:45293)
0929 06:38:57.812498 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:57.812500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:57.812578 (+ 78us) server_negotiation.cc:407] Connection header received
0929 06:38:57.812654 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:57.812655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:57.812667 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:57.812741 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:57.813073 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:57.813574 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:57.814384 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:57.814608 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:57.814695 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:57.817128 (+ 2433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:37631: BlockingRecv error: recv got EOF from 127.15.157.130:37631 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Sep 29 06:38:57 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:57 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:57.957901 25167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:57.953202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:53707)
0929 06:38:57.953449 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:57.953461 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:57.953566 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:57.953692 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:57.953693 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:57.953878 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:57.953919 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:57.953921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:57.954620 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:57.954620 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:57.955151 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:57.955152 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:57.955527 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:57.955528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:57.955598 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:57.956070 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:57.956074 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:57.957841 (+ 1767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":145,"threads_started":1}
W20260929 06:38:57.958099 25165 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:57.953245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:53707 (local address 127.15.157.190:45293)
0929 06:38:57.953361 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:57.953364 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:57.953531 (+ 167us) server_negotiation.cc:407] Connection header received
0929 06:38:57.953628 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:57.953629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:57.953642 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:57.953687 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:57.953997 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:57.954520 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:57.955235 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:57.955441 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:57.955526 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:57.957947 (+ 2421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:53707: BlockingRecv error: recv got EOF from 127.15.157.131:53707 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Sep 29 06:38:58 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:58 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:58.717229 25168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:58.712655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:60571)
0929 06:38:58.712811 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:58.712829 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:58.712875 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:58.713015 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:58.713016 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:58.713178 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:58.713224 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:58.713226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:58.713848 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:58.713849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:58.714502 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:58.714505 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:58.714822 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:58.714823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:58.714860 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:58.715352 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:58.715357 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:58.717134 (+ 1777us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":105,"threads_started":1}
W20260929 06:38:58.717276 25169 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:58.712725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:60571 (local address 127.15.157.190:45293)
0929 06:38:58.712866 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:58.712868 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:58.712877 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:58.712918 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:58.712919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:58.712928 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:58.712989 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:58.713289 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:58.713780 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:58.714574 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:58.714760 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:58.714815 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:58.717210 (+ 2395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:60571: BlockingRecv error: recv got EOF from 127.15.157.129:60571 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
Sep 29 06:38:58 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:58 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:58.822130 25170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:58.817694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:49491)
0929 06:38:58.817837 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:58.817848 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:58.817895 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:58.818073 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:58.818073 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:58.818232 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:58.818277 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:58.818278 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:58.818882 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:58.818882 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:58.819394 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:58.819395 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:58.819845 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:58.819846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:58.819912 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:58.820371 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:58.820376 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:58.822072 (+ 1696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
W20260929 06:38:58.822197 25169 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:58.817809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:49491 (local address 127.15.157.190:45293)
0929 06:38:58.817873 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:58.817875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:58.817884 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:58.817956 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:58.817956 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:58.817966 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:58.818010 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:58.818340 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:58.818818 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:58.819487 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:58.819735 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:58.819818 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:58.822150 (+ 2332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:49491: BlockingRecv error: recv got EOF from 127.15.157.130:49491 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Sep 29 06:38:58 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:58 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:58.962972 25171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:58.958438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:38943)
0929 06:38:58.958615 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:58.958635 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:58.958702 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:58.958841 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:58.958841 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:58.958999 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:58.959053 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:58.959054 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:58.959753 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:58.959755 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:58.960296 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:58.960298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:58.960654 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:58.960655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:58.960721 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:58.961153 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:58.961158 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:58.962904 (+ 1746us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":127,"threads_started":1}
W20260929 06:38:58.963114 25169 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:58.958536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:38943 (local address 127.15.157.190:45293)
0929 06:38:58.958606 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:58.958608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:58.958698 (+ 90us) server_negotiation.cc:407] Connection header received
0929 06:38:58.958749 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:58.958750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:58.958762 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:58.958820 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:58.959160 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:58.959656 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:58.960384 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:58.960577 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:58.960656 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:58.963030 (+ 2374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:38943: BlockingRecv error: recv got EOF from 127.15.157.131:38943 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Sep 29 06:38:59 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:59 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:59.722483 25172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:59.717765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:36085)
0929 06:38:59.717899 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:59.717917 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:59.717966 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:59.718142 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:59.718143 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:59.718362 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:59.718428 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:59.718430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:59.719247 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:59.719248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:59.719794 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:59.719796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:59.720120 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:59.720121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:59.720160 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:59.720679 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:59.720684 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:59.722419 (+ 1735us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":86,"threads_started":1}
W20260929 06:38:59.722621 25173 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:59.717834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:36085 (local address 127.15.157.190:45293)
0929 06:38:59.718001 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:59.718003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:59.718029 (+ 26us) server_negotiation.cc:407] Connection header received
0929 06:38:59.718053 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:59.718053 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:59.718064 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:59.718134 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:59.718524 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:59.719180 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:59.719865 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:59.720058 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:59.720119 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:59.722530 (+ 2411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:36085: BlockingRecv error: recv got EOF from 127.15.157.129:36085 (error 108)
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":100,"threads_started":1}
Sep 29 06:38:59 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:59 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:59.827454 25174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:59.822643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:34585)
0929 06:38:59.822831 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:59.822843 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:59.822911 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:59.823045 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:59.823046 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:59.823229 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:59.823271 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:59.823273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:59.823958 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:59.823960 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:59.824509 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:59.824511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:59.824898 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:59.824899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:59.824957 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:59.825395 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:59.825399 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:59.827347 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":104,"threads_started":1}
W20260929 06:38:59.827484 25173 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:59.822742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:34585 (local address 127.15.157.190:45293)
0929 06:38:59.822815 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:59.822818 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:59.822892 (+ 74us) server_negotiation.cc:407] Connection header received
0929 06:38:59.822969 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:59.822970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:59.822981 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:59.823033 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:59.823351 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:59.823867 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:59.824603 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:59.824815 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:59.824898 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:59.827421 (+ 2523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:34585: BlockingRecv error: recv got EOF from 127.15.157.130:34585 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Sep 29 06:38:59 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:38:59 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.131@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:38:59.968080 25175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:59.963489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.131:35981)
0929 06:38:59.963652 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:59.963662 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:59.963729 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:59.963860 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:59.963861 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:59.964050 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:59.964106 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:59.964110 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:59.964763 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:59.964764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:59.965336 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:59.965338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:59.965645 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:59.965646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:59.965715 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:59.966163 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:59.966168 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:59.967978 (+ 1810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":92,"threads_started":1}
W20260929 06:38:59.968133 25173 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:59.963529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:35981 (local address 127.15.157.190:45293)
0929 06:38:59.963589 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:59.963591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:59.963726 (+ 135us) server_negotiation.cc:407] Connection header received
0929 06:38:59.963784 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:59.963785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:59.963797 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:59.963839 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:59.964181 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:59.964701 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:59.965401 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:59.965584 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:59.965635 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:59.968068 (+ 2433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.131:35981: BlockingRecv error: recv got EOF from 127.15.157.131:35981 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Sep 29 06:39:00 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:39:00 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.129@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:39:00.727448 25176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:00.723006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.129:56379)
0929 06:39:00.723163 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:00.723175 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:00.723237 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:00.723399 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:00.723401 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:00.723559 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:39:00.723608 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:00.723610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:00.724252 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:00.724253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:00.724834 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:00.724836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:00.725163 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:00.725164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:00.725220 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:00.725680 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:39:00.725685 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:39:00.727390 (+ 1705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":89,"threads_started":1}
W20260929 06:39:00.727635 25177 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:39:00.723053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:56379 (local address 127.15.157.190:45293)
0929 06:39:00.723166 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:00.723169 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:00.723225 (+ 56us) server_negotiation.cc:407] Connection header received
0929 06:39:00.723287 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:00.723288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:00.723298 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:00.723354 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:00.723684 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:00.724175 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:00.724908 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:00.725093 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:00.725140 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:00.727544 (+ 2404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.129:56379: BlockingRecv error: recv got EOF from 127.15.157.129:56379 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":49,"threads_started":1}
Sep 29 06:39:00 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:39:00 dist-test-slave-ltw5 krb5kdc[24118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.157.130@KRBTEST.COM for oryx/127.15.157.190@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:39:00.833123 25178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:00.828085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45293 (local address 127.15.157.130:57787)
0929 06:39:00.828287 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:00.828299 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:00.828391 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:00.828564 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:00.828565 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:00.828754 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:39:00.828798 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:00.828800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:00.829473 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:00.829474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:00.830144 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:00.830147 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:00.830642 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:00.830643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:00.830706 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:00.831233 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:39:00.831238 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:39:00.833027 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.157.190:45293: Server oryx/127.15.157.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":102,"threads_started":1}
W20260929 06:39:00.833160 25177 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:39:00.828190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:57787 (local address 127.15.157.190:45293)
0929 06:39:00.828266 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:00.828268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:00.828372 (+ 104us) server_negotiation.cc:407] Connection header received
0929 06:39:00.828461 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:00.828462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:00.828473 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:00.828547 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:00.828876 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:00.829388 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:00.830248 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:00.830571 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:00.830646 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:00.833101 (+ 2455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.157.130:57787: BlockingRecv error: recv got EOF from 127.15.157.130:57787 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 06:39:00.884068 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 24701
I20260929 06:39:00.888463 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 24853
I20260929 06:39:00.892469 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 24987
I20260929 06:39:00.896615 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 24631
2026-09-29T06:39:00Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17450 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-09-29T06:39:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:39:00Z Disabled control of system clock
I20260929 06:39:00.923751 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:37179
--webserver_interface=127.15.157.190
--webserver_port=0
--builtin_ntp_servers=127.15.157.148:35545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:37179
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260929 06:39:01.002542 25182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:01.002731 25182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:01.002751 25182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:01.003932 25182 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:39:01.003974 25182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:01.003994 25182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:01.004007 25182 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:39:01.004061 25182 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:39:01.005373 25182 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:35545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:37179
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:37179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:01.005620 25182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:01.005918 25182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:01.011189 25190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:01.011184 25187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:01.011343 25188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:01.011389 25182 server_base.cc:1034] running on GCE node
I20260929 06:39:01.011767 25182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:01.012086 25182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:01.013257 25182 hybrid_clock.cc:648] HybridClock initialized: now 1790663941013225 us; error 34 us; skew 500 ppm
I20260929 06:39:01.014515 25182 webserver.cc:460] Webserver started at http://127.15.157.190:44685/ using document root <none> and password file <none>
I20260929 06:39:01.014771 25182 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:01.014839 25182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:01.014974 25182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:39:01.016032 25182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "bceedc63c90b4e0da761542b6ef427c8"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "3b23d9142c5a5a9f69ae69ad56b44721"
server_key_iv: "b9dacc2d1a1266f20aab86d2e3461c5b"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.016403 25182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "bceedc63c90b4e0da761542b6ef427c8"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "3b23d9142c5a5a9f69ae69ad56b44721"
server_key_iv: "b9dacc2d1a1266f20aab86d2e3461c5b"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.017654 25182 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:39:01.018438 25196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.018605 25182 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.018702 25182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "bceedc63c90b4e0da761542b6ef427c8"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "3b23d9142c5a5a9f69ae69ad56b44721"
server_key_iv: "b9dacc2d1a1266f20aab86d2e3461c5b"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.018781 25182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:01.025748 25182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:01.026109 25182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:01.026275 25182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:01.030221 25182 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:37179
I20260929 06:39:01.030262 25248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:37179 every 8 connection(s)
I20260929 06:39:01.030608 25182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:39:01.031287 25249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:39:01.033711 25249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8: Bootstrap starting.
I20260929 06:39:01.034325 25249 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8: Neither blocks nor log segments found. Creating new log.
I20260929 06:39:01.034561 25249 log.cc:824] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8: Log is configured to *not* fsync() on all Append() calls
I20260929 06:39:01.035151 25249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8: No bootstrap required, opened a new log
I20260929 06:39:01.036640 25249 raft_consensus.cc:348] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bceedc63c90b4e0da761542b6ef427c8" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 37179 } }
I20260929 06:39:01.036774 25249 raft_consensus.cc:374] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:39:01.036798 25249 raft_consensus.cc:729] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bceedc63c90b4e0da761542b6ef427c8, State: Initialized, Role: FOLLOWER
I20260929 06:39:01.036938 25249 consensus_queue.cc:260] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bceedc63c90b4e0da761542b6ef427c8" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 37179 } }
I20260929 06:39:01.037027 25249 raft_consensus.cc:388] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:39:01.037050 25249 raft_consensus.cc:482] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:39:01.037082 25249 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:39:01.037591 25249 raft_consensus.cc:504] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bceedc63c90b4e0da761542b6ef427c8" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 37179 } }
I20260929 06:39:01.037704 25249 leader_election.cc:302] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bceedc63c90b4e0da761542b6ef427c8; no voters:
I20260929 06:39:01.037719 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 25182
I20260929 06:39:01.037803 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:39:01.037869 25249 leader_election.cc:288] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:39:01.037914 25252 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:39:01.038045 15990 external_mini_cluster.cc:1428] Setting key 1109f33e067070b5438443877c9e6d0b
I20260929 06:39:01.038105 25252 raft_consensus.cc:686] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [term 1 LEADER]: Becoming Leader. State: Replica: bceedc63c90b4e0da761542b6ef427c8, State: Running, Role: LEADER
I20260929 06:39:01.038152 25249 sys_catalog.cc:564] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:39:01.038676 25252 consensus_queue.cc:237] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bceedc63c90b4e0da761542b6ef427c8" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 37179 } }
I20260929 06:39:01.039176 25253 sys_catalog.cc:455] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bceedc63c90b4e0da761542b6ef427c8. Latest consensus state: current_term: 1 leader_uuid: "bceedc63c90b4e0da761542b6ef427c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bceedc63c90b4e0da761542b6ef427c8" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 37179 } } }
I20260929 06:39:01.039198 25254 sys_catalog.cc:455] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bceedc63c90b4e0da761542b6ef427c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bceedc63c90b4e0da761542b6ef427c8" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 37179 } } }
I20260929 06:39:01.039366 25253 sys_catalog.cc:458] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [sys.catalog]: This master's current role is: LEADER
I20260929 06:39:01.039623 25254 sys_catalog.cc:458] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8 [sys.catalog]: This master's current role is: LEADER
I20260929 06:39:01.039834 25264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:39:01.040380 25264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:39:01.041803 25264 catalog_manager.cc:1347] Generated new cluster ID: c4c78c349af64fe189ba2bc0e9a85a2a
I20260929 06:39:01.041852 25264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:39:01.044459 25256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:01.038689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33626 (local address 127.15.157.190:37179)
0929 06:39:01.039100 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:01.039108 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:01.039140 (+ 32us) server_negotiation.cc:407] Connection header received
0929 06:39:01.039264 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:01.039271 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:01.039341 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:01.039768 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:01.039869 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:01.041286 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:01.042333 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:01.042933 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:01.043062 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:01.043750 (+ 688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:01.043754 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:01.043754 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:39:01.043966 (+ 212us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:01.044010 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:39:01.044025 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:01.044095 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:01.044165 (+ 70us) server_negotiation.cc:299] Negotiation successful
0929 06:39:01.044245 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":70,"threads_started":1}
I20260929 06:39:01.055932 25264 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:39:01.056437 25264 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:39:01.063171 25264 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bceedc63c90b4e0da761542b6ef427c8: Generated new TSK 0
I20260929 06:39:01.063357 25264 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:39:01.065127 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:37179
--builtin_ntp_servers=127.15.157.148:35545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260929 06:39:01.147951 25273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:01.148186 25273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:01.148222 25273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:01.149355 25273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:01.149422 25273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:01.149464 25273 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:39:01.150852 25273 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:35545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:37179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25273
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:01.151114 25273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:01.151399 25273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:01.156340 25281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:01.156360 25278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:01.156380 25279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:01.156576 25273 server_base.cc:1034] running on GCE node
I20260929 06:39:01.156826 25273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:01.157087 25273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:01.158231 25273 hybrid_clock.cc:648] HybridClock initialized: now 1790663941158214 us; error 33 us; skew 500 ppm
I20260929 06:39:01.159514 25273 webserver.cc:460] Webserver started at http://127.15.157.129:42875/ using document root <none> and password file <none>
I20260929 06:39:01.159770 25273 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:01.159837 25273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:01.160002 25273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:39:01.161051 25273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "cb64d910a93c4b1dba15da0814a7c9d0"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "fa698dcbdc9b58836cb5187ec7268219"
server_key_iv: "11d004844f24739bf369b1a2298ab523"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.161422 25273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "cb64d910a93c4b1dba15da0814a7c9d0"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "fa698dcbdc9b58836cb5187ec7268219"
server_key_iv: "11d004844f24739bf369b1a2298ab523"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.162808 25273 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:39:01.163491 25287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.163666 25273 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:39:01.163758 25273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "cb64d910a93c4b1dba15da0814a7c9d0"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "fa698dcbdc9b58836cb5187ec7268219"
server_key_iv: "11d004844f24739bf369b1a2298ab523"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.163838 25273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:01.182888 25273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:01.183192 25273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:01.183341 25273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:01.183557 25273 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:39:01.183877 25273 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:39:01.183930 25273 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.183971 25273 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:39:01.184008 25273 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.189625 25273 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:35997
I20260929 06:39:01.189671 25400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:35997 every 8 connection(s)
I20260929 06:39:01.189987 25273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:39:01.192842 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 25273
I20260929 06:39:01.192943 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:39:01.193142 15990 external_mini_cluster.cc:1428] Setting key d043a7e1f6b172a9469f3254ed0ca833
I20260929 06:39:01.194156 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:37179
--builtin_ntp_servers=127.15.157.148:35545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260929 06:39:01.195861 25256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:01.190754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:40939 (local address 127.15.157.190:37179)
0929 06:39:01.190816 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:01.190818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:01.191060 (+ 242us) server_negotiation.cc:407] Connection header received
0929 06:39:01.191525 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:01.191526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:01.191538 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:01.191599 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:01.192217 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:01.192729 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:01.194282 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:01.194558 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:01.194622 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:01.195555 (+ 933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:01.195556 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:01.195557 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:39:01.195563 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:01.195582 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:39:01.195586 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:01.195649 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:01.195724 (+ 75us) server_negotiation.cc:299] Negotiation successful
0929 06:39:01.195759 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 06:39:01.196033 25403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:01.190738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:37179 (local address 127.15.157.129:40939)
0929 06:39:01.190923 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:01.190969 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:01.191439 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:01.191651 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:01.191654 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:01.191662 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:39:01.192149 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:01.192153 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:01.192826 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:01.192827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:01.194159 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:01.194162 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:01.194652 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:01.194653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:01.194813 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:01.195376 (+ 563us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:39:01.195377 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:39:01.195421 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:39:01.195452 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:39:01.195647 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:39:01.195650 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:39:01.195652 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:39:01.195703 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 06:39:01.195779 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":75,"threads_started":1}
I20260929 06:39:01.196513 25401 heartbeater.cc:347] Connected to a master server at 127.15.157.190:37179
I20260929 06:39:01.196601 25401 heartbeater.cc:464] Registering TS with master...
I20260929 06:39:01.196787 25401 heartbeater.cc:511] Master 127.15.157.190:37179 requested a full tablet report, sending...
I20260929 06:39:01.197274 25213 ts_manager.cc:194] Registered new tserver with Master: cb64d910a93c4b1dba15da0814a7c9d0 (127.15.157.129:35997)
I20260929 06:39:01.197961 25213 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.157.129:40939
W20260929 06:39:01.275064 25404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:01.275318 25404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:01.275357 25404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:01.276501 25404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:01.276566 25404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:01.276610 25404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:39:01.278113 25404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:35545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:37179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:01.278357 25404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:01.278654 25404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:01.284376 25410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:01.284468 25404 server_base.cc:1034] running on GCE node
W20260929 06:39:01.284428 25412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:01.284409 25409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:01.284785 25404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:01.285036 25404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:01.286188 25404 hybrid_clock.cc:648] HybridClock initialized: now 1790663941286153 us; error 49 us; skew 500 ppm
I20260929 06:39:01.287350 25404 webserver.cc:460] Webserver started at http://127.15.157.130:34657/ using document root <none> and password file <none>
I20260929 06:39:01.287595 25404 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:01.287664 25404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:01.287799 25404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:39:01.288915 25404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "a5708f1c2d4f42e3aa27164802b15296"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "f89bcef13920416032f5a6355f22acc4"
server_key_iv: "c54ddf4f9b7702cdba9df59761a529ad"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.289292 25404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "a5708f1c2d4f42e3aa27164802b15296"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "f89bcef13920416032f5a6355f22acc4"
server_key_iv: "c54ddf4f9b7702cdba9df59761a529ad"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.290621 25404 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:39:01.291308 25418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.291469 25404 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:39:01.291565 25404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "a5708f1c2d4f42e3aa27164802b15296"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "f89bcef13920416032f5a6355f22acc4"
server_key_iv: "c54ddf4f9b7702cdba9df59761a529ad"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.291646 25404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:01.299504 25404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:01.299777 25404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:01.299921 25404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:01.300132 25404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:39:01.300436 25404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:39:01.300495 25404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.300535 25404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:39:01.300563 25404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.306123 25404 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:38361
I20260929 06:39:01.306174 25531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:38361 every 8 connection(s)
I20260929 06:39:01.306505 25404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:39:01.309350 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 25404
I20260929 06:39:01.309444 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:39:01.309619 15990 external_mini_cluster.cc:1428] Setting key d2b1e4db130a6b4a18df8c1f750886ee
I20260929 06:39:01.310571 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:37179
--builtin_ntp_servers=127.15.157.148:35545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260929 06:39:01.311719 25256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:01.307239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:35885 (local address 127.15.157.190:37179)
0929 06:39:01.307324 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:01.307326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:01.307530 (+ 204us) server_negotiation.cc:407] Connection header received
0929 06:39:01.307989 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:01.307990 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:01.307999 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:01.308051 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:01.308639 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:01.309115 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:01.310400 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:01.310581 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:01.310662 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:01.311488 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:01.311489 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:01.311490 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:39:01.311494 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:01.311507 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:39:01.311510 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:01.311553 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:01.311639 (+ 86us) server_negotiation.cc:299] Negotiation successful
0929 06:39:01.311662 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260929 06:39:01.312000 25534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:01.307214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:37179 (local address 127.15.157.130:35885)
0929 06:39:01.307415 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:01.307445 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:01.307900 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:01.308102 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:01.308105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:01.308113 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:39:01.308572 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:01.308577 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:01.309197 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:01.309198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:01.310319 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:01.310322 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:01.310670 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:01.310671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:01.310825 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:01.311342 (+ 517us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:39:01.311343 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:39:01.311379 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:39:01.311405 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:39:01.311568 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:39:01.311571 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:39:01.311574 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:39:01.311643 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 06:39:01.311747 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":108,"threads_started":1}
I20260929 06:39:01.312495 25532 heartbeater.cc:347] Connected to a master server at 127.15.157.190:37179
I20260929 06:39:01.312597 25532 heartbeater.cc:464] Registering TS with master...
I20260929 06:39:01.312783 25532 heartbeater.cc:511] Master 127.15.157.190:37179 requested a full tablet report, sending...
I20260929 06:39:01.313145 25213 ts_manager.cc:194] Registered new tserver with Master: a5708f1c2d4f42e3aa27164802b15296 (127.15.157.130:38361)
I20260929 06:39:01.313524 25213 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.157.130:35885
W20260929 06:39:01.390874 25535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:01.391091 25535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:01.391112 25535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:01.392278 25535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:01.392320 25535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:01.392345 25535 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:39:01.393662 25535 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:35545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:37179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25535
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:01.393914 25535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:01.394321 25535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:01.399359 25541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:01.399372 25535 server_base.cc:1034] running on GCE node
W20260929 06:39:01.399371 25543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:01.399506 25540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:01.399718 25535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:01.399973 25535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:01.401150 25535 hybrid_clock.cc:648] HybridClock initialized: now 1790663941401125 us; error 53 us; skew 500 ppm
I20260929 06:39:01.402436 25535 webserver.cc:460] Webserver started at http://127.15.157.131:32879/ using document root <none> and password file <none>
I20260929 06:39:01.402686 25535 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:01.402755 25535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:01.402905 25535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:39:01.403964 25535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "29472cfced724519bbcd22514d3c5767"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "b90c057e838fee7b34c297f4d0920e93"
server_key_iv: "62a367e7789fe66fb199362729b4f009"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.404345 25535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "29472cfced724519bbcd22514d3c5767"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "b90c057e838fee7b34c297f4d0920e93"
server_key_iv: "62a367e7789fe66fb199362729b4f009"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.405640 25535 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:39:01.406440 25549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.406618 25535 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.406718 25535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "29472cfced724519bbcd22514d3c5767"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "b90c057e838fee7b34c297f4d0920e93"
server_key_iv: "62a367e7789fe66fb199362729b4f009"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.406816 25535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:01.427155 25535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:01.427508 25535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:01.427670 25535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:01.427912 25535 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:39:01.428269 25535 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:39:01.428330 25535 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.428366 25535 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:39:01.428393 25535 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.434193 25535 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:33449
I20260929 06:39:01.434253 25662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:33449 every 8 connection(s)
I20260929 06:39:01.434633 25535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:39:01.436182 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 25535
I20260929 06:39:01.436278 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:39:01.436481 15990 external_mini_cluster.cc:1428] Setting key 93262f54a9a5c4511ee8bddefab824b9
I20260929 06:39:01.440476 25256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:01.435457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:58687 (local address 127.15.157.190:37179)
0929 06:39:01.435516 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:01.435517 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:01.435774 (+ 257us) server_negotiation.cc:407] Connection header received
0929 06:39:01.436545 (+ 771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:01.436546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:01.436559 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:01.436632 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:01.437354 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:01.437922 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:01.439034 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:01.439235 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:01.439315 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:01.440151 (+ 836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:01.440152 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:01.440152 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:39:01.440158 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:01.440177 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:39:01.440181 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:01.440251 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:01.440344 (+ 93us) server_negotiation.cc:299] Negotiation successful
0929 06:39:01.440374 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 06:39:01.440693 25665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:01.435448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:37179 (local address 127.15.157.131:58687)
0929 06:39:01.435648 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:01.435682 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:01.436380 (+ 698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:01.436735 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:01.436738 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:01.436746 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:39:01.437253 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:01.437257 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:01.438055 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:01.438056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:01.438942 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:01.438945 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:01.439333 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:01.439334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:01.439463 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:01.440007 (+ 544us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:39:01.440007 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:39:01.440036 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:39:01.440060 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:39:01.440249 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:39:01.440255 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:39:01.440258 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:39:01.440347 (+ 89us) client_negotiation.cc:240] Negotiation successful
0929 06:39:01.440451 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":90,"threads_started":1}
I20260929 06:39:01.441154 25663 heartbeater.cc:347] Connected to a master server at 127.15.157.190:37179
I20260929 06:39:01.441248 25663 heartbeater.cc:464] Registering TS with master...
I20260929 06:39:01.441452 25663 heartbeater.cc:511] Master 127.15.157.190:37179 requested a full tablet report, sending...
I20260929 06:39:01.441823 25213 ts_manager.cc:194] Registered new tserver with Master: 29472cfced724519bbcd22514d3c5767 (127.15.157.131:33449)
I20260929 06:39:01.442267 25213 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.157.131:58687
I20260929 06:39:01.448195 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260929 06:39:01.450084 25256 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:39:01.449538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33640 (local address 127.15.157.190:37179)
0929 06:39:01.449582 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:01.449584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:01.449713 (+ 129us) server_negotiation.cc:407] Connection header received
0929 06:39:01.449769 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:01.449770 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:01.449780 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:01.449831 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:01.449964 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33640: BlockingRecv error: recv got EOF from 127.0.0.1:33640 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:39:01.450161 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 25273
I20260929 06:39:01.455292 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 25404
I20260929 06:39:01.459981 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 25535
I20260929 06:39:01.464190 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 25182
2026-09-29T06:39:01Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (566 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-09-29T06:39:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:39:01Z Disabled control of system clock
I20260929 06:39:01.490450 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:40243
--webserver_interface=127.15.157.190
--webserver_port=0
--builtin_ntp_servers=127.15.157.148:45295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:40243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260929 06:39:01.572552 25674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:01.572794 25674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:01.572816 25674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:01.573985 25674 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:39:01.574051 25674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:01.574065 25674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:01.574079 25674 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:39:01.574146 25674 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:39:01.575577 25674 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:45295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:40243
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:40243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:01.575852 25674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:01.576166 25674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:01.580945 25682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:01.580969 25679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:01.580955 25680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:01.581175 25674 server_base.cc:1034] running on GCE node
I20260929 06:39:01.581485 25674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:01.581734 25674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:01.582868 25674 hybrid_clock.cc:648] HybridClock initialized: now 1790663941582829 us; error 64 us; skew 500 ppm
I20260929 06:39:01.584054 25674 webserver.cc:460] Webserver started at http://127.15.157.190:39283/ using document root <none> and password file <none>
I20260929 06:39:01.584311 25674 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:01.584355 25674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:01.584497 25674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:39:01.585543 25674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "bd20390e47f845be94c59434fa2630f9"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "619ce1cf46fb0c7965387e115a3023a5"
server_key_iv: "e2d81f76748787bc698e6045f4eb3eb7"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.585894 25674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "bd20390e47f845be94c59434fa2630f9"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "619ce1cf46fb0c7965387e115a3023a5"
server_key_iv: "e2d81f76748787bc698e6045f4eb3eb7"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.587196 25674 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:39:01.587889 25688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.588079 25674 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:39:01.588167 25674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "bd20390e47f845be94c59434fa2630f9"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "619ce1cf46fb0c7965387e115a3023a5"
server_key_iv: "e2d81f76748787bc698e6045f4eb3eb7"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.588236 25674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:01.591490 25674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:01.591754 25674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:01.591892 25674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:01.595660 25674 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:40243
I20260929 06:39:01.595690 25740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:40243 every 8 connection(s)
I20260929 06:39:01.596010 25674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:39:01.596657 25741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:39:01.599345 25741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9: Bootstrap starting.
I20260929 06:39:01.599918 25741 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9: Neither blocks nor log segments found. Creating new log.
I20260929 06:39:01.600207 25741 log.cc:824] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9: Log is configured to *not* fsync() on all Append() calls
I20260929 06:39:01.600840 25741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9: No bootstrap required, opened a new log
I20260929 06:39:01.602460 25741 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd20390e47f845be94c59434fa2630f9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40243 } }
I20260929 06:39:01.602609 25741 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:39:01.602654 25741 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd20390e47f845be94c59434fa2630f9, State: Initialized, Role: FOLLOWER
I20260929 06:39:01.602809 25741 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd20390e47f845be94c59434fa2630f9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40243 } }
I20260929 06:39:01.602872 25741 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:39:01.602914 25741 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:39:01.602962 25741 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:39:01.603469 25741 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd20390e47f845be94c59434fa2630f9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40243 } }
I20260929 06:39:01.603585 25741 leader_election.cc:302] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd20390e47f845be94c59434fa2630f9; no voters:
I20260929 06:39:01.603772 25741 leader_election.cc:288] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:39:01.603812 25744 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:39:01.603955 25744 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [term 1 LEADER]: Becoming Leader. State: Replica: bd20390e47f845be94c59434fa2630f9, State: Running, Role: LEADER
I20260929 06:39:01.604027 25741 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:39:01.604132 25744 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd20390e47f845be94c59434fa2630f9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40243 } }
I20260929 06:39:01.604499 25746 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd20390e47f845be94c59434fa2630f9. Latest consensus state: current_term: 1 leader_uuid: "bd20390e47f845be94c59434fa2630f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd20390e47f845be94c59434fa2630f9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40243 } } }
I20260929 06:39:01.604657 25746 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [sys.catalog]: This master's current role is: LEADER
I20260929 06:39:01.604671 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 25674
I20260929 06:39:01.604712 25745 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd20390e47f845be94c59434fa2630f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd20390e47f845be94c59434fa2630f9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40243 } } }
I20260929 06:39:01.604754 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:39:01.604804 25745 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9 [sys.catalog]: This master's current role is: LEADER
I20260929 06:39:01.604936 15990 external_mini_cluster.cc:1428] Setting key 4bb6cbe56cd126534f12543b701a098f
W20260929 06:39:01.606297 25762 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:39:01.606365 25762 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:39:01.606447 25748 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:39:01.606626 25748 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:39:01.607496 25756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:01.605469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49002 (local address 127.15.157.190:40243)
0929 06:39:01.605801 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:01.605812 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:01.605848 (+ 36us) server_negotiation.cc:407] Connection header received
0929 06:39:01.605964 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:01.605971 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:01.606037 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:01.606184 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:01.606885 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:01.606889 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:01.606889 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:39:01.606893 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:01.606954 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:39:01.606969 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:01.607221 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:01.607253 (+ 32us) server_negotiation.cc:299] Negotiation successful
0929 06:39:01.607307 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":70,"threads_started":1}
I20260929 06:39:01.610452 25748 catalog_manager.cc:1347] Generated new cluster ID: d57891d649744632879fb9edad98fc7f
I20260929 06:39:01.610520 25748 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:39:01.634191 25748 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:39:01.634385 25748 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:39:01.638741 25748 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd20390e47f845be94c59434fa2630f9: Generated new TSK 0
I20260929 06:39:01.638952 25748 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:39:01.645151 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:40243
--builtin_ntp_servers=127.15.157.148:45295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260929 06:39:01.736333 25765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:01.736636 25765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:01.736677 25765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:01.737902 25765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:01.737942 25765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:01.737968 25765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:39:01.739349 25765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:45295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:40243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:01.739596 25765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:01.739912 25765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:01.744961 25770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:01.744985 25773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:01.745187 25765 server_base.cc:1034] running on GCE node
W20260929 06:39:01.744987 25771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:01.745594 25765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:01.745849 25765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:01.747015 25765 hybrid_clock.cc:648] HybridClock initialized: now 1790663941746984 us; error 52 us; skew 500 ppm
I20260929 06:39:01.752738 25765 webserver.cc:460] Webserver started at http://127.15.157.129:32861/ using document root <none> and password file <none>
I20260929 06:39:01.753019 25765 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:01.753093 25765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:01.753244 25765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:39:01.754393 25765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "d5d198e9a2f743cc9b19f784474b67d0"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "25773e9b58ca75ec7f3f024590b5763d"
server_key_iv: "4bca737998fa1d31007e4f7fdb775ae8"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.754750 25765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "d5d198e9a2f743cc9b19f784474b67d0"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "25773e9b58ca75ec7f3f024590b5763d"
server_key_iv: "4bca737998fa1d31007e4f7fdb775ae8"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.756073 25765 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:39:01.756742 25779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.756904 25765 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:39:01.757014 25765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "d5d198e9a2f743cc9b19f784474b67d0"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "25773e9b58ca75ec7f3f024590b5763d"
server_key_iv: "4bca737998fa1d31007e4f7fdb775ae8"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.757088 25765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:01.760437 25765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:01.760701 25765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:01.760843 25765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:01.761065 25765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:39:01.761359 25765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:39:01.761412 25765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.761451 25765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:39:01.761479 25765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.767318 25765 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:40811
I20260929 06:39:01.767359 25892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:40811 every 8 connection(s)
I20260929 06:39:01.767669 25765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:39:01.770469 25756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:01.768365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:55951 (local address 127.15.157.190:40243)
0929 06:39:01.768429 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:01.768431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:01.768643 (+ 212us) server_negotiation.cc:407] Connection header received
0929 06:39:01.769073 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:01.769073 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:01.769078 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:01.769141 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:01.770250 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:01.770251 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:01.770252 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:39:01.770256 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:01.770271 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:39:01.770275 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:01.770326 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:01.770400 (+ 74us) server_negotiation.cc:299] Negotiation successful
0929 06:39:01.770415 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 06:39:01.770655 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 25765
I20260929 06:39:01.770705 25895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:01.768316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:40243 (local address 127.15.157.129:55951)
0929 06:39:01.768511 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:01.768550 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:01.768992 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:01.769211 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:01.769215 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:01.769223 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:39:01.770107 (+ 884us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:39:01.770107 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:39:01.770136 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:39:01.770165 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:39:01.770333 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:39:01.770336 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:39:01.770339 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:39:01.770395 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 06:39:01.770479 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":94,"threads_started":1}
I20260929 06:39:01.770757 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:39:01.770955 15990 external_mini_cluster.cc:1428] Setting key 0f5d14b172e05fc65515286fba9f5c17
I20260929 06:39:01.771178 25893 heartbeater.cc:347] Connected to a master server at 127.15.157.190:40243
I20260929 06:39:01.771279 25893 heartbeater.cc:464] Registering TS with master...
I20260929 06:39:01.771422 25893 heartbeater.cc:511] Master 127.15.157.190:40243 requested a full tablet report, sending...
I20260929 06:39:01.771904 25705 ts_manager.cc:194] Registered new tserver with Master: d5d198e9a2f743cc9b19f784474b67d0 (127.15.157.129:40811)
I20260929 06:39:01.771929 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:40243
--builtin_ntp_servers=127.15.157.148:45295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260929 06:39:01.851092 25896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:01.851297 25896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:01.851320 25896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:01.852509 25896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:01.852552 25896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:01.852578 25896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:39:01.853914 25896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:45295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:40243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:01.854195 25896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:01.854496 25896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:01.859397 25904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:01.859421 25896 server_base.cc:1034] running on GCE node
W20260929 06:39:01.859510 25901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:01.859398 25902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:01.859812 25896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:01.860071 25896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:01.861222 25896 hybrid_clock.cc:648] HybridClock initialized: now 1790663941861218 us; error 37 us; skew 500 ppm
I20260929 06:39:01.862519 25896 webserver.cc:460] Webserver started at http://127.15.157.130:46429/ using document root <none> and password file <none>
I20260929 06:39:01.862754 25896 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:01.862820 25896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:01.862963 25896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:39:01.864097 25896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "31faea6ed14545b0a95420fe3685ffe5"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "89fa095974c0a01b089f830a8b170e45"
server_key_iv: "7a7b88a5578f61752f9ad59ff57110d8"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.864463 25896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "31faea6ed14545b0a95420fe3685ffe5"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "89fa095974c0a01b089f830a8b170e45"
server_key_iv: "7a7b88a5578f61752f9ad59ff57110d8"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.865763 25896 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:39:01.866626 25910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.866794 25896 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:39:01.866887 25896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "31faea6ed14545b0a95420fe3685ffe5"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "89fa095974c0a01b089f830a8b170e45"
server_key_iv: "7a7b88a5578f61752f9ad59ff57110d8"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.866971 25896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:01.870260 25896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:01.870514 25896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:01.870654 25896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:01.870867 25896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:39:01.871160 25896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:39:01.871210 25896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.871248 25896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:39:01.871275 25896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.876694 25896 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:42897
I20260929 06:39:01.876772 26023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:42897 every 8 connection(s)
I20260929 06:39:01.877086 25896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:39:01.879859 25756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:01.877826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:58497 (local address 127.15.157.190:40243)
0929 06:39:01.877870 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:01.877872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:01.878068 (+ 196us) server_negotiation.cc:407] Connection header received
0929 06:39:01.878530 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:01.878531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:01.878536 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:01.878599 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:01.879679 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:01.879680 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:01.879680 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:39:01.879684 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:01.879698 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:39:01.879703 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:01.879750 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:01.879797 (+ 47us) server_negotiation.cc:299] Negotiation successful
0929 06:39:01.879809 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:39:01.880088 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:01.877768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:40243 (local address 127.15.157.130:58497)
0929 06:39:01.877941 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:01.877980 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:01.878444 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:01.878659 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:01.878662 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:01.878671 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:39:01.879540 (+ 869us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:39:01.879541 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:39:01.879567 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:39:01.879594 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:39:01.879746 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:39:01.879749 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:39:01.879751 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:39:01.879803 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 06:39:01.879849 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":86,"threads_started":1}
I20260929 06:39:01.880618 26024 heartbeater.cc:347] Connected to a master server at 127.15.157.190:40243
I20260929 06:39:01.880712 26024 heartbeater.cc:464] Registering TS with master...
I20260929 06:39:01.880891 26024 heartbeater.cc:511] Master 127.15.157.190:40243 requested a full tablet report, sending...
I20260929 06:39:01.881261 25705 ts_manager.cc:194] Registered new tserver with Master: 31faea6ed14545b0a95420fe3685ffe5 (127.15.157.130:42897)
I20260929 06:39:01.886507 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 25896
I20260929 06:39:01.886590 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:39:01.886727 15990 external_mini_cluster.cc:1428] Setting key a3d023735eea8a3122b5a920a13d246f
I20260929 06:39:01.887593 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:40243
--builtin_ntp_servers=127.15.157.148:45295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260929 06:39:01.965631 26027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:01.965827 26027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:01.965849 26027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:01.966955 26027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:01.966989 26027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:01.967016 26027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:39:01.968261 26027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:45295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:40243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:01.968441 26027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:01.968683 26027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:01.973528 26035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:01.973677 26027 server_base.cc:1034] running on GCE node
W20260929 06:39:01.973501 26032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:01.973562 26033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:01.974061 26027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:01.974320 26027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:01.975476 26027 hybrid_clock.cc:648] HybridClock initialized: now 1790663941975475 us; error 33 us; skew 500 ppm
I20260929 06:39:01.976652 26027 webserver.cc:460] Webserver started at http://127.15.157.131:45511/ using document root <none> and password file <none>
I20260929 06:39:01.976889 26027 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:01.976955 26027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:01.977100 26027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:39:01.978263 26027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "5fa4ead9a3314069b6cc30e3296b100a"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "508c4ba0914ecefc253cd56a1af821a8"
server_key_iv: "9dc3d15b12e464b48d99f9a40bfa7009"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.978619 26027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "5fa4ead9a3314069b6cc30e3296b100a"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "508c4ba0914ecefc253cd56a1af821a8"
server_key_iv: "9dc3d15b12e464b48d99f9a40bfa7009"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.979842 26027 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:39:01.980541 26041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.980702 26027 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:39:01.980796 26027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "5fa4ead9a3314069b6cc30e3296b100a"
format_stamp: "Formatted at 2026-09-29 06:39:01 on dist-test-slave-ltw5"
server_key: "508c4ba0914ecefc253cd56a1af821a8"
server_key_iv: "9dc3d15b12e464b48d99f9a40bfa7009"
server_key_version: "encryptionkey@0"
I20260929 06:39:01.980871 26027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:01.984119 26027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:01.984354 26027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:01.984488 26027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:01.984694 26027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:39:01.984932 26027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:39:01.984961 26027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.984982 26027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:39:01.984994 26027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:01.990463 26027 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:34495
I20260929 06:39:01.990511 26154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:34495 every 8 connection(s)
I20260929 06:39:01.990795 26027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:39:01.991846 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 26027
I20260929 06:39:01.991933 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:39:01.992106 15990 external_mini_cluster.cc:1428] Setting key 7aa6618abb64e4d60f16ff4030d20b82
I20260929 06:39:01.993781 25756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:01.991388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:34359 (local address 127.15.157.190:40243)
0929 06:39:01.991433 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:01.991436 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:01.991713 (+ 277us) server_negotiation.cc:407] Connection header received
0929 06:39:01.992194 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:01.992196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:01.992203 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:01.992273 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:01.993556 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:01.993557 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:01.993558 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:39:01.993562 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:01.993576 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:39:01.993581 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:01.993632 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:01.993698 (+ 66us) server_negotiation.cc:299] Negotiation successful
0929 06:39:01.993712 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:39:01.993965 26157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:01.991402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:40243 (local address 127.15.157.131:34359)
0929 06:39:01.991574 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:01.991604 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:01.992085 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:01.992360 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:01.992365 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:01.992374 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:39:01.993403 (+ 1029us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:39:01.993404 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:39:01.993431 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:39:01.993456 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:39:01.993629 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:39:01.993633 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:39:01.993636 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:39:01.993708 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 06:39:01.993764 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":81,"threads_started":1}
I20260929 06:39:01.994473 26155 heartbeater.cc:347] Connected to a master server at 127.15.157.190:40243
I20260929 06:39:01.994555 26155 heartbeater.cc:464] Registering TS with master...
I20260929 06:39:01.994658 26155 heartbeater.cc:511] Master 127.15.157.190:40243 requested a full tablet report, sending...
I20260929 06:39:01.995021 25705 ts_manager.cc:194] Registered new tserver with Master: 5fa4ead9a3314069b6cc30e3296b100a (127.15.157.131:34495)
I20260929 06:39:02.003796 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260929 06:39:02.005573 25756 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:39:02.005110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49004 (local address 127.15.157.190:40243)
0929 06:39:02.005182 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:02.005184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:02.005282 (+ 98us) server_negotiation.cc:407] Connection header received
0929 06:39:02.005333 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:02.005334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:02.005338 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:02.005394 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:02.005524 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49004: BlockingRecv error: recv got EOF from 127.0.0.1:49004 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260929 06:39:02.005679 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 25765
I20260929 06:39:02.010632 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 25896
I20260929 06:39:02.014727 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 26027
I20260929 06:39:02.018883 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 25674
2026-09-29T06:39:02Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (554 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:39:02 dist-test-slave-ltw5 krb5kdc[26165](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:39:02 dist-test-slave-ltw5 krb5kdc[26165](info): set up 2 sockets
Sep 29 06:39:02 dist-test-slave-ltw5 krb5kdc[26165](info): commencing operation
krb5kdc: starting...
W20260929 06:39:03.055176 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:39:03 dist-test-slave-ltw5 krb5kdc[26165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663943, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:39:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:39:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:39:03.177147 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:44263
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:44263
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:39:03.255869 26178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:03.256114 26178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:03.256151 26178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:03.257287 26178 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:39:03.257357 26178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:03.257382 26178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:03.257405 26178 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:39:03.257433 26178 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:39:03.258957 26178 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:44263
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:44263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26178
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:03.259227 26178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:03.259449 26178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:03.264339 26183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:03.264362 26178 server_base.cc:1034] running on GCE node
W20260929 06:39:03.264343 26186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:03.264343 26184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:03.264797 26178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:03.265084 26178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:03.266296 26178 hybrid_clock.cc:648] HybridClock initialized: now 1790663943266290 us; error 35 us; skew 500 ppm
Sep 29 06:39:03 dist-test-slave-ltw5 krb5kdc[26165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663943, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:39:03.268728 26178 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:39:03.269196 26178 webserver.cc:460] Webserver started at http://127.15.157.190:42929/ using document root <none> and password file <none>
I20260929 06:39:03.269418 26178 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:03.269482 26178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:03.269629 26178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:39:03.270714 26178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "810c495160f041caa2051067ac75ae21"
format_stamp: "Formatted at 2026-09-29 06:39:03 on dist-test-slave-ltw5"
server_key: "8e98675ec7e440a03b5c6faf332ede1b"
server_key_iv: "25c95d79ec8513bafd548d00197f0a8a"
server_key_version: "encryptionkey@0"
I20260929 06:39:03.271073 26178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "810c495160f041caa2051067ac75ae21"
format_stamp: "Formatted at 2026-09-29 06:39:03 on dist-test-slave-ltw5"
server_key: "8e98675ec7e440a03b5c6faf332ede1b"
server_key_iv: "25c95d79ec8513bafd548d00197f0a8a"
server_key_version: "encryptionkey@0"
I20260929 06:39:03.272367 26178 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:39:03.273099 26193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:03.273259 26178 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:39:03.273356 26178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "810c495160f041caa2051067ac75ae21"
format_stamp: "Formatted at 2026-09-29 06:39:03 on dist-test-slave-ltw5"
server_key: "8e98675ec7e440a03b5c6faf332ede1b"
server_key_iv: "25c95d79ec8513bafd548d00197f0a8a"
server_key_version: "encryptionkey@0"
I20260929 06:39:03.273437 26178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:03.289920 26178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:03.291960 26178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:03.292111 26178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:03.296099 26178 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:44263
I20260929 06:39:03.296130 26245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:44263 every 8 connection(s)
I20260929 06:39:03.296481 26178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:39:03.297406 26246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:39:03.299685 26246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21: Bootstrap starting.
I20260929 06:39:03.300210 26246 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21: Neither blocks nor log segments found. Creating new log.
I20260929 06:39:03.300427 26246 log.cc:824] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21: Log is configured to *not* fsync() on all Append() calls
I20260929 06:39:03.301035 26246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21: No bootstrap required, opened a new log
I20260929 06:39:03.301481 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 26178
I20260929 06:39:03.301597 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:39:03.301766 15990 external_mini_cluster.cc:1428] Setting key a4b24d74edce6a8a117645851904f431
I20260929 06:39:03.303584 26246 raft_consensus.cc:348] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c495160f041caa2051067ac75ae21" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44263 } }
I20260929 06:39:03.303751 26246 raft_consensus.cc:374] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:39:03.303788 26246 raft_consensus.cc:729] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810c495160f041caa2051067ac75ae21, State: Initialized, Role: FOLLOWER
I20260929 06:39:03.303939 26246 consensus_queue.cc:260] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c495160f041caa2051067ac75ae21" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44263 } }
I20260929 06:39:03.304025 26246 raft_consensus.cc:388] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:39:03.304047 26246 raft_consensus.cc:482] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:39:03.304108 26246 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:39:03.304694 26246 raft_consensus.cc:504] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c495160f041caa2051067ac75ae21" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44263 } }
I20260929 06:39:03.304795 26246 leader_election.cc:302] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 810c495160f041caa2051067ac75ae21; no voters:
I20260929 06:39:03.304934 26246 leader_election.cc:288] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:39:03.304991 26251 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:39:03.305169 26246 sys_catalog.cc:564] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:39:03.305189 26251 raft_consensus.cc:686] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [term 1 LEADER]: Becoming Leader. State: Replica: 810c495160f041caa2051067ac75ae21, State: Running, Role: LEADER
I20260929 06:39:03.305272 26251 consensus_queue.cc:237] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c495160f041caa2051067ac75ae21" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44263 } }
I20260929 06:39:03.305622 26251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 810c495160f041caa2051067ac75ae21. Latest consensus state: current_term: 1 leader_uuid: "810c495160f041caa2051067ac75ae21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c495160f041caa2051067ac75ae21" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44263 } } }
I20260929 06:39:03.305704 26251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [sys.catalog]: This master's current role is: LEADER
I20260929 06:39:03.305644 26252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "810c495160f041caa2051067ac75ae21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c495160f041caa2051067ac75ae21" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44263 } } }
I20260929 06:39:03.305809 26252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21 [sys.catalog]: This master's current role is: LEADER
I20260929 06:39:03.306154 26260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:39:03.306661 26260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 29 06:39:03 dist-test-slave-ltw5 krb5kdc[26165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663943, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:39:03.312928 26260 catalog_manager.cc:1347] Generated new cluster ID: 6088f696bedc40d59f8a0cacab810a2e
I20260929 06:39:03.312978 26260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:39:03.313320 26250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:03.302289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44030 (local address 127.15.157.190:44263)
0929 06:39:03.302537 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:03.302546 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:03.302580 (+ 34us) server_negotiation.cc:407] Connection header received
0929 06:39:03.303535 (+ 955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:03.303544 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:03.303606 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:03.303758 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:03.304499 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.305888 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.306993 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.307449 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.307565 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:03.310049 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:03.310053 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:03.310053 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:39:03.310065 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:03.311600 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:03.312074 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:03.312078 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:03.312078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:03.312201 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:03.312413 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:03.312414 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:03.312414 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:03.312679 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:03.312840 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:03.312953 (+ 113us) server_negotiation.cc:299] Negotiation successful
0929 06:39:03.313086 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":170,"threads_started":1}
I20260929 06:39:03.326570 26260 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:39:03.327097 26260 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:39:03.334412 26260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21: Generated new TSK 0
I20260929 06:39:03.334604 26260 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:39:03.364377 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:44263
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:39:03.445989 26272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:03.446223 26272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:03.446245 26272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:03.447417 26272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:03.447463 26272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:03.447489 26272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:39:03.448917 26272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:44263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:03.449159 26272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:03.449402 26272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:03.454547 26277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:03.454578 26272 server_base.cc:1034] running on GCE node
W20260929 06:39:03.454542 26280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:03.454579 26278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:03.454931 26272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:03.455139 26272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:03.456274 26272 hybrid_clock.cc:648] HybridClock initialized: now 1790663943456264 us; error 26 us; skew 500 ppm
Sep 29 06:39:03 dist-test-slave-ltw5 krb5kdc[26165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663943, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:39:03.458810 26272 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:39:03.459252 26272 webserver.cc:460] Webserver started at http://127.15.157.129:36411/ using document root <none> and password file <none>
I20260929 06:39:03.459486 26272 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:03.459553 26272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:03.459703 26272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:39:03.460733 26272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b"
format_stamp: "Formatted at 2026-09-29 06:39:03 on dist-test-slave-ltw5"
server_key: "3920454f8effcec6fe30fc6d36c2826d"
server_key_iv: "99d6f80fae8477b2668a3dbd34af5a53"
server_key_version: "encryptionkey@0"
I20260929 06:39:03.461107 26272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b"
format_stamp: "Formatted at 2026-09-29 06:39:03 on dist-test-slave-ltw5"
server_key: "3920454f8effcec6fe30fc6d36c2826d"
server_key_iv: "99d6f80fae8477b2668a3dbd34af5a53"
server_key_version: "encryptionkey@0"
I20260929 06:39:03.462491 26272 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:39:03.463214 26287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:03.463379 26272 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:39:03.463485 26272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b"
format_stamp: "Formatted at 2026-09-29 06:39:03 on dist-test-slave-ltw5"
server_key: "3920454f8effcec6fe30fc6d36c2826d"
server_key_iv: "99d6f80fae8477b2668a3dbd34af5a53"
server_key_version: "encryptionkey@0"
I20260929 06:39:03.463558 26272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:03.474599 26272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:03.476575 26272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:03.476733 26272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:03.476958 26272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:39:03.477272 26272 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:39:03.477330 26272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:03.477366 26272 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:39:03.477396 26272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:03.483642 26272 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:46401
I20260929 06:39:03.483680 26400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:46401 every 8 connection(s)
I20260929 06:39:03.484023 26272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:39:03.489537 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 26272
I20260929 06:39:03.489662 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:39:03.489846 15990 external_mini_cluster.cc:1428] Setting key 130a6f65a4d5e4ecd41ad6471ce8a847
Sep 29 06:39:03 dist-test-slave-ltw5 krb5kdc[26165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663943, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:39:03.493700 26250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:03.484705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:33565 (local address 127.15.157.190:44263)
0929 06:39:03.484776 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:03.484778 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:03.484971 (+ 193us) server_negotiation.cc:407] Connection header received
0929 06:39:03.485450 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:03.485451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:03.485461 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:03.485518 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:03.486517 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.487005 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.488008 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.488202 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.488251 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:03.490577 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:03.490578 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:03.490578 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:39:03.490588 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:03.492246 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:03.492681 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:03.492683 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:03.492683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:03.492742 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:03.493020 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:03.493021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:03.493021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:03.493162 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:03.493231 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:03.493468 (+ 237us) server_negotiation.cc:299] Negotiation successful
0929 06:39:03.493555 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260929 06:39:03.493721 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:03.484700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:44263 (local address 127.15.157.129:33565)
0929 06:39:03.484845 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:03.484880 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:03.485370 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:03.485573 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:03.485577 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:03.486223 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:39:03.486426 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:03.486431 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.487106 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.487107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:03.487930 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:03.487932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.488273 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.488274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:03.488374 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:03.488841 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:39:03.488850 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:39:03.490464 (+ 1614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:39:03.492362 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:39:03.492369 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:39:03.492370 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:39:03.492593 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:39:03.492829 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:39:03.492830 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:39:03.492830 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:39:03.492936 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:39:03.493230 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:39:03.493234 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:39:03.493343 (+ 109us) client_negotiation.cc:769] Sending connection context
0929 06:39:03.493425 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 06:39:03.493547 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":84,"threads_started":1}
I20260929 06:39:03.494333 26401 heartbeater.cc:347] Connected to a master server at 127.15.157.190:44263
I20260929 06:39:03.494439 26401 heartbeater.cc:464] Registering TS with master...
I20260929 06:39:03.494629 26401 heartbeater.cc:511] Master 127.15.157.190:44263 requested a full tablet report, sending...
I20260929 06:39:03.495215 26210 ts_manager.cc:194] Registered new tserver with Master: 0e6c4e85514842c28dd3d86cdb5d1e5b (127.15.157.129:46401)
I20260929 06:39:03.496217 26210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:33565
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:39:03.514734 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:44263
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:39:03.593880 26406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:03.594095 26406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:03.594120 26406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:03.595252 26406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:03.595316 26406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:03.595345 26406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:39:03.596765 26406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:44263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:03.596989 26406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:03.597221 26406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:03.602157 26412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:03.602154 26414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:03.602157 26411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:03.602514 26406 server_base.cc:1034] running on GCE node
I20260929 06:39:03.602730 26406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:03.602962 26406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:03.604139 26406 hybrid_clock.cc:648] HybridClock initialized: now 1790663943604117 us; error 39 us; skew 500 ppm
Sep 29 06:39:03 dist-test-slave-ltw5 krb5kdc[26165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663943, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:39:03.606686 26406 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:39:03.607131 26406 webserver.cc:460] Webserver started at http://127.15.157.130:45939/ using document root <none> and password file <none>
I20260929 06:39:03.607345 26406 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:03.607409 26406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:03.607553 26406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:39:03.608536 26406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "8d1d1ad5cd4e406d88dcab3408ecd067"
format_stamp: "Formatted at 2026-09-29 06:39:03 on dist-test-slave-ltw5"
server_key: "6a86a99ba7a321a3da747ce6ea025b82"
server_key_iv: "fe0ccf16b5f1f364a30909bdfcfd3b38"
server_key_version: "encryptionkey@0"
I20260929 06:39:03.608893 26406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "8d1d1ad5cd4e406d88dcab3408ecd067"
format_stamp: "Formatted at 2026-09-29 06:39:03 on dist-test-slave-ltw5"
server_key: "6a86a99ba7a321a3da747ce6ea025b82"
server_key_iv: "fe0ccf16b5f1f364a30909bdfcfd3b38"
server_key_version: "encryptionkey@0"
I20260929 06:39:03.610150 26406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:39:03.610824 26421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:03.610981 26406 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:39:03.611073 26406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "8d1d1ad5cd4e406d88dcab3408ecd067"
format_stamp: "Formatted at 2026-09-29 06:39:03 on dist-test-slave-ltw5"
server_key: "6a86a99ba7a321a3da747ce6ea025b82"
server_key_iv: "fe0ccf16b5f1f364a30909bdfcfd3b38"
server_key_version: "encryptionkey@0"
I20260929 06:39:03.611150 26406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:03.623901 26406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:03.626207 26406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:03.626358 26406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:03.626583 26406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:39:03.626883 26406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:39:03.626937 26406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:03.626978 26406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:39:03.627005 26406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:03.632875 26406 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:44125
I20260929 06:39:03.632925 26534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:44125 every 8 connection(s)
I20260929 06:39:03.633221 26406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:39:03 dist-test-slave-ltw5 krb5kdc[26165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663943, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:39:03.639302 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 26406
I20260929 06:39:03.639432 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:39:03.639600 15990 external_mini_cluster.cc:1428] Setting key 40ac83b18d890b89f05e56ccc02871a8
I20260929 06:39:03.642624 26250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:03.633901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:46043 (local address 127.15.157.190:44263)
0929 06:39:03.633948 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:03.633950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:03.634170 (+ 220us) server_negotiation.cc:407] Connection header received
0929 06:39:03.634745 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:03.634747 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:03.634787 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:03.634862 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:03.635823 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.636334 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.637339 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.637543 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.637636 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:03.639807 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:03.639808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:03.639809 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:39:03.639832 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:03.641201 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:03.641626 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:03.641628 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:03.641628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:03.641688 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:03.641936 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:03.641937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:03.641937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:03.642117 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:03.642191 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:03.642449 (+ 258us) server_negotiation.cc:299] Negotiation successful
0929 06:39:03.642535 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:39:03.642820 26537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:03.633873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:44263 (local address 127.15.157.130:46043)
0929 06:39:03.634057 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:03.634099 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:03.634627 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:03.634930 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:03.634934 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:03.635532 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:39:03.635716 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:03.635721 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.636437 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.636438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:03.637241 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:03.637243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.637643 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.637644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:03.637773 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:03.638273 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:39:03.638281 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:39:03.639692 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:39:03.641331 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:39:03.641336 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:39:03.641338 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:39:03.641553 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:39:03.641757 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:39:03.641758 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:39:03.641758 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:39:03.641866 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:39:03.642182 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:39:03.642188 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:39:03.642322 (+ 134us) client_negotiation.cc:769] Sending connection context
0929 06:39:03.642429 (+ 107us) client_negotiation.cc:240] Negotiation successful
0929 06:39:03.642578 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":92,"threads_started":1}
I20260929 06:39:03.643463 26535 heartbeater.cc:347] Connected to a master server at 127.15.157.190:44263
I20260929 06:39:03.643584 26535 heartbeater.cc:464] Registering TS with master...
I20260929 06:39:03.643750 26535 heartbeater.cc:511] Master 127.15.157.190:44263 requested a full tablet report, sending...
I20260929 06:39:03.644133 26210 ts_manager.cc:194] Registered new tserver with Master: 8d1d1ad5cd4e406d88dcab3408ecd067 (127.15.157.130:44125)
I20260929 06:39:03.644681 26210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:46043
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:39:03.663101 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:44263
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:39:03.742379 26540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:03.742575 26540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:03.742599 26540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:03.743672 26540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:03.743703 26540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:03.743728 26540 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:39:03.745055 26540 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:44263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:03.745231 26540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:03.745385 26540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:03.750202 26545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:03.750319 26540 server_base.cc:1034] running on GCE node
W20260929 06:39:03.750203 26548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:03.750377 26546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:03.750610 26540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:03.750833 26540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:03.751986 26540 hybrid_clock.cc:648] HybridClock initialized: now 1790663943751967 us; error 31 us; skew 500 ppm
Sep 29 06:39:03 dist-test-slave-ltw5 krb5kdc[26165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663943, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:39:03.754393 26540 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:39:03.754761 26540 webserver.cc:460] Webserver started at http://127.15.157.131:36297/ using document root <none> and password file <none>
I20260929 06:39:03.754926 26540 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:03.754963 26540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:03.755050 26540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:39:03.755991 26540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "9121fd7b8cbd43b28318265031a1725f"
format_stamp: "Formatted at 2026-09-29 06:39:03 on dist-test-slave-ltw5"
server_key: "6d5802ffef0050c18a27242a8da1f959"
server_key_iv: "3b13e24d3a4a83390677b622952b9d54"
server_key_version: "encryptionkey@0"
I20260929 06:39:03.756271 26540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "9121fd7b8cbd43b28318265031a1725f"
format_stamp: "Formatted at 2026-09-29 06:39:03 on dist-test-slave-ltw5"
server_key: "6d5802ffef0050c18a27242a8da1f959"
server_key_iv: "3b13e24d3a4a83390677b622952b9d54"
server_key_version: "encryptionkey@0"
I20260929 06:39:03.757471 26540 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:39:03.758121 26555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:03.758270 26540 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:03.758335 26540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "9121fd7b8cbd43b28318265031a1725f"
format_stamp: "Formatted at 2026-09-29 06:39:03 on dist-test-slave-ltw5"
server_key: "6d5802ffef0050c18a27242a8da1f959"
server_key_iv: "3b13e24d3a4a83390677b622952b9d54"
server_key_version: "encryptionkey@0"
I20260929 06:39:03.758383 26540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:03.771301 26540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:03.773438 26540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:03.773551 26540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:03.773722 26540 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:39:03.773950 26540 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:39:03.773979 26540 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:03.774001 26540 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:39:03.774101 26540 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:03.780022 26540 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:36617
I20260929 06:39:03.780079 26668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:36617 every 8 connection(s)
I20260929 06:39:03.780370 26540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:39:03 dist-test-slave-ltw5 krb5kdc[26165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663943, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:39:03.787398 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 26540
I20260929 06:39:03.787518 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:39:03.787711 15990 external_mini_cluster.cc:1428] Setting key 477228d5c52a7aeba00d0e00a78bd373
I20260929 06:39:03.789287 26250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:03.781070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:44191 (local address 127.15.157.190:44263)
0929 06:39:03.781118 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:03.781119 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:03.781338 (+ 219us) server_negotiation.cc:407] Connection header received
0929 06:39:03.781844 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:03.781845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:03.781856 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:03.781916 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:03.782875 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.783366 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.784362 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.784563 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.784664 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:03.786661 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:03.786662 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:03.786663 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:39:03.786670 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:03.788055 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:03.788520 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:03.788521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:03.788521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:03.788598 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:03.788825 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:03.788825 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:03.788825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:03.788925 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:03.788981 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:03.789167 (+ 186us) server_negotiation.cc:299] Negotiation successful
0929 06:39:03.789226 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:39:03.789438 26671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:03.781047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:44263 (local address 127.15.157.131:44191)
0929 06:39:03.781220 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:03.781252 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:03.781739 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:03.781988 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:03.781992 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:03.782585 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:39:03.782761 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:03.782765 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.783458 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.783459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:03.784257 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:03.784259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.784671 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.784672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:03.784797 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:03.785217 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:39:03.785225 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:39:03.786569 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:39:03.788142 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:39:03.788148 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:39:03.788150 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:39:03.788437 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:39:03.788669 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:39:03.788670 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:39:03.788670 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:39:03.788783 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:39:03.788975 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:39:03.788981 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:39:03.789083 (+ 102us) client_negotiation.cc:769] Sending connection context
0929 06:39:03.789155 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 06:39:03.789261 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":89,"threads_started":1}
I20260929 06:39:03.789906 26669 heartbeater.cc:347] Connected to a master server at 127.15.157.190:44263
I20260929 06:39:03.789996 26669 heartbeater.cc:464] Registering TS with master...
I20260929 06:39:03.790200 26669 heartbeater.cc:511] Master 127.15.157.190:44263 requested a full tablet report, sending...
I20260929 06:39:03.790555 26210 ts_manager.cc:194] Registered new tserver with Master: 9121fd7b8cbd43b28318265031a1725f (127.15.157.131:36617)
I20260929 06:39:03.790912 26210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:44191
I20260929 06:39:03.799512 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:39:03.806488 26250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:03.800764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44038 (local address 127.15.157.190:44263)
0929 06:39:03.800818 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:03.800819 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:03.800950 (+ 131us) server_negotiation.cc:407] Connection header received
0929 06:39:03.800988 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:03.800988 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:03.800997 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:03.801045 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:03.801576 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.802075 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.802777 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.802951 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.803002 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:03.804053 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:03.804054 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:03.804055 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:39:03.804060 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:03.805506 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:03.805821 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:03.805822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:03.805822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:03.805868 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:03.806099 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:03.806099 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:03.806100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:03.806220 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:03.806291 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:03.806373 (+ 82us) server_negotiation.cc:299] Negotiation successful
0929 06:39:03.806426 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 06:39:03.808171 26210 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44038:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:39:03.809623 26210 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:39:03.816099 26677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:03.811759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:46401 (local address 127.0.0.1:38994)
0929 06:39:03.812264 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:03.812271 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:03.812335 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:03.812589 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:03.812590 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:03.812592 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:39:03.812634 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:03.812635 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.813690 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.813690 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:03.815116 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:03.815118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.815802 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.815803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:03.815880 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:03.815892 (+ 12us) client_negotiation.cc:769] Sending connection context
0929 06:39:03.815966 (+ 74us) client_negotiation.cc:240] Negotiation successful
0929 06:39:03.816021 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"mutex_wait_us":70,"thread_start_us":41,"threads_started":1}
I20260929 06:39:03.816222 26679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:03.811711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38658 (local address 127.15.157.130:44125)
0929 06:39:03.811872 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:03.811877 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:03.812107 (+ 230us) server_negotiation.cc:407] Connection header received
0929 06:39:03.812159 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:03.812160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:03.812173 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:03.812515 (+ 342us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:39:03.812710 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.813766 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.815065 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.815789 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.815861 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:03.815913 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:03.816112 (+ 199us) server_negotiation.cc:299] Negotiation successful
0929 06:39:03.816148 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":96,"threads_started":1}
I20260929 06:39:03.816179 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:03.811859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48778 (local address 127.15.157.131:36617)
0929 06:39:03.812037 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:03.812043 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:03.812056 (+ 13us) server_negotiation.cc:407] Connection header received
0929 06:39:03.812110 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:03.812112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:03.812130 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:03.812207 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:39:03.812373 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.813543 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.815195 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.815865 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.815932 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:03.815974 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:03.816057 (+ 83us) server_negotiation.cc:299] Negotiation successful
0929 06:39:03.816104 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":79,"threads_started":1}
I20260929 06:39:03.816447 26678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:03.811534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:36617 (local address 127.0.0.1:48778)
0929 06:39:03.811908 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:03.811947 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:03.812022 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:03.812219 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:03.812222 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:03.812224 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:39:03.812287 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:03.812288 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.813666 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.813667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:03.815117 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:03.815118 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.815926 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.815926 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:03.815995 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:03.815997 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:39:03.816047 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 06:39:03.816079 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":36,"thread_start_us":68,"threads_started":1}
I20260929 06:39:03.816367 26681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:03.811846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38994 (local address 127.15.157.129:46401)
0929 06:39:03.811997 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:03.812001 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:03.812332 (+ 331us) server_negotiation.cc:407] Connection header received
0929 06:39:03.812407 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:03.812410 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:03.812441 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:03.812513 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:39:03.812701 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.813572 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.815211 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.815705 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.815795 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:03.815849 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:03.816227 (+ 378us) server_negotiation.cc:299] Negotiation successful
0929 06:39:03.816274 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":80,"threads_started":1}
I20260929 06:39:03.816622 26680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:03.811593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:44125 (local address 127.0.0.1:38658)
0929 06:39:03.812018 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:03.812029 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:03.812094 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:03.812590 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:03.812590 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:03.812593 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:39:03.812632 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:03.812633 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.813849 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.813849 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:03.814972 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:03.814974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:03.815947 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:03.815948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:03.816020 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:03.816024 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:39:03.816321 (+ 297us) client_negotiation.cc:240] Negotiation successful
0929 06:39:03.816364 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":1,"thread_start_us":63,"threads_started":1}
I20260929 06:39:03.817246 26335 tablet_service.cc:1467] Processing CreateTablet for tablet 0cdb61f5d8e4400abd5c3f41211bf2c2 (DEFAULT_TABLE table=test-table [id=b403f839ccf0441ba87888f97cfc902e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:39:03.817337 26469 tablet_service.cc:1467] Processing CreateTablet for tablet 0cdb61f5d8e4400abd5c3f41211bf2c2 (DEFAULT_TABLE table=test-table [id=b403f839ccf0441ba87888f97cfc902e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:39:03.817386 26603 tablet_service.cc:1467] Processing CreateTablet for tablet 0cdb61f5d8e4400abd5c3f41211bf2c2 (DEFAULT_TABLE table=test-table [id=b403f839ccf0441ba87888f97cfc902e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:39:03.817601 26335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cdb61f5d8e4400abd5c3f41211bf2c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:39:03.817670 26603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cdb61f5d8e4400abd5c3f41211bf2c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:39:03.817669 26469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cdb61f5d8e4400abd5c3f41211bf2c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:39:03.820966 26684 tablet_bootstrap.cc:492] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b: Bootstrap starting.
I20260929 06:39:03.821200 26685 tablet_bootstrap.cc:492] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f: Bootstrap starting.
I20260929 06:39:03.821590 26684 tablet_bootstrap.cc:654] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b: Neither blocks nor log segments found. Creating new log.
I20260929 06:39:03.821797 26685 tablet_bootstrap.cc:654] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f: Neither blocks nor log segments found. Creating new log.
I20260929 06:39:03.822166 26684 log.cc:824] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b: Log is configured to *not* fsync() on all Append() calls
I20260929 06:39:03.822183 26683 tablet_bootstrap.cc:492] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067: Bootstrap starting.
I20260929 06:39:03.822384 26685 log.cc:824] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f: Log is configured to *not* fsync() on all Append() calls
I20260929 06:39:03.822788 26683 tablet_bootstrap.cc:654] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067: Neither blocks nor log segments found. Creating new log.
I20260929 06:39:03.823136 26685 tablet_bootstrap.cc:492] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f: No bootstrap required, opened a new log
I20260929 06:39:03.823200 26685 ts_tablet_manager.cc:1397] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 06:39:03.823277 26683 log.cc:824] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067: Log is configured to *not* fsync() on all Append() calls
I20260929 06:39:03.823992 26683 tablet_bootstrap.cc:492] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067: No bootstrap required, opened a new log
I20260929 06:39:03.824069 26684 tablet_bootstrap.cc:492] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b: No bootstrap required, opened a new log
I20260929 06:39:03.824084 26683 ts_tablet_manager.cc:1397] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:39:03.824132 26684 ts_tablet_manager.cc:1397] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:39:03.825098 26685 raft_consensus.cc:348] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9121fd7b8cbd43b28318265031a1725f" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36617 } } peers { permanent_uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46401 } } peers { permanent_uuid: "8d1d1ad5cd4e406d88dcab3408ecd067" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 44125 } }
I20260929 06:39:03.825260 26685 raft_consensus.cc:374] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:39:03.825292 26685 raft_consensus.cc:729] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9121fd7b8cbd43b28318265031a1725f, State: Initialized, Role: FOLLOWER
I20260929 06:39:03.825405 26685 consensus_queue.cc:260] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9121fd7b8cbd43b28318265031a1725f" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36617 } } peers { permanent_uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46401 } } peers { permanent_uuid: "8d1d1ad5cd4e406d88dcab3408ecd067" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 44125 } }
I20260929 06:39:03.825496 26683 raft_consensus.cc:348] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9121fd7b8cbd43b28318265031a1725f" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36617 } } peers { permanent_uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46401 } } peers { permanent_uuid: "8d1d1ad5cd4e406d88dcab3408ecd067" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 44125 } }
I20260929 06:39:03.825670 26685 ts_tablet_manager.cc:1428] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260929 06:39:03.825675 26683 raft_consensus.cc:374] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:39:03.825719 26683 raft_consensus.cc:729] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d1d1ad5cd4e406d88dcab3408ecd067, State: Initialized, Role: FOLLOWER
I20260929 06:39:03.825788 26669 heartbeater.cc:503] Master 127.15.157.190:44263 was elected leader, sending a full tablet report...
I20260929 06:39:03.825866 26683 consensus_queue.cc:260] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9121fd7b8cbd43b28318265031a1725f" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36617 } } peers { permanent_uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46401 } } peers { permanent_uuid: "8d1d1ad5cd4e406d88dcab3408ecd067" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 44125 } }
I20260929 06:39:03.826169 26683 ts_tablet_manager.cc:1428] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:39:03.826071 26684 raft_consensus.cc:348] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9121fd7b8cbd43b28318265031a1725f" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36617 } } peers { permanent_uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46401 } } peers { permanent_uuid: "8d1d1ad5cd4e406d88dcab3408ecd067" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 44125 } }
I20260929 06:39:03.826299 26535 heartbeater.cc:503] Master 127.15.157.190:44263 was elected leader, sending a full tablet report...
I20260929 06:39:03.826221 26684 raft_consensus.cc:374] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:39:03.826535 26684 raft_consensus.cc:729] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e6c4e85514842c28dd3d86cdb5d1e5b, State: Initialized, Role: FOLLOWER
I20260929 06:39:03.826663 26684 consensus_queue.cc:260] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9121fd7b8cbd43b28318265031a1725f" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36617 } } peers { permanent_uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46401 } } peers { permanent_uuid: "8d1d1ad5cd4e406d88dcab3408ecd067" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 44125 } }
I20260929 06:39:03.826941 26684 ts_tablet_manager.cc:1428] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:39:03.826941 26401 heartbeater.cc:503] Master 127.15.157.190:44263 was elected leader, sending a full tablet report...
W20260929 06:39:03.883822 26536 tablet.cc:2369] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:39:03.984819 26402 tablet.cc:2369] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:39:04.030906 26670 tablet.cc:2369] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:39:04.130647 26689 raft_consensus.cc:482] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:39:04.130779 26689 raft_consensus.cc:504] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9121fd7b8cbd43b28318265031a1725f" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36617 } } peers { permanent_uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46401 } } peers { permanent_uuid: "8d1d1ad5cd4e406d88dcab3408ecd067" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 44125 } }
I20260929 06:39:04.131139 26689 leader_election.cc:288] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e6c4e85514842c28dd3d86cdb5d1e5b (127.15.157.129:46401), 8d1d1ad5cd4e406d88dcab3408ecd067 (127.15.157.130:44125)
I20260929 06:39:04.134963 26681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:04.131436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:41995 (local address 127.15.157.129:46401)
0929 06:39:04.131487 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:04.131489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:04.131593 (+ 104us) server_negotiation.cc:407] Connection header received
0929 06:39:04.131655 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:04.131657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:04.131665 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:04.131718 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:39:04.131873 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:04.132610 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:04.134228 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:04.134612 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:04.134700 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:04.134708 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:04.134855 (+ 147us) server_negotiation.cc:299] Negotiation successful
0929 06:39:04.134890 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 06:39:04.134959 26679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:04.131360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:43445 (local address 127.15.157.130:44125)
0929 06:39:04.131418 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:04.131420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:04.131434 (+ 14us) server_negotiation.cc:407] Connection header received
0929 06:39:04.131536 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:04.131537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:04.131547 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:04.131630 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:39:04.131850 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:04.132611 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:04.134251 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:04.134602 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:04.134698 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:04.134707 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:04.134853 (+ 146us) server_negotiation.cc:299] Negotiation successful
0929 06:39:04.134889 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 06:39:04.134970 26671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:04.131326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:44125 (local address 127.15.157.131:43445)
0929 06:39:04.131392 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:04.131405 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:04.131471 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:04.131660 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:04.131661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:04.131662 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:39:04.131756 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:04.131758 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:04.132712 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:04.132713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:04.134137 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:04.134140 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:04.134697 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:04.134697 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:04.134777 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:04.134780 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:39:04.134848 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 06:39:04.134888 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":99}
I20260929 06:39:04.135095 26692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:04.131338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:46401 (local address 127.15.157.131:41995)
0929 06:39:04.131506 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:04.131525 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:04.131582 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:04.131740 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:04.131741 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:04.131742 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:39:04.131794 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:04.131795 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:04.132712 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:04.132713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:04.134137 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:04.134140 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:04.134700 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:04.134701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:04.134780 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:04.134783 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:39:04.134851 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 06:39:04.134890 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":98,"thread_start_us":112,"threads_started":1}
I20260929 06:39:04.135319 26489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cdb61f5d8e4400abd5c3f41211bf2c2" candidate_uuid: "9121fd7b8cbd43b28318265031a1725f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d1d1ad5cd4e406d88dcab3408ecd067" is_pre_election: true
I20260929 06:39:04.135411 26355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cdb61f5d8e4400abd5c3f41211bf2c2" candidate_uuid: "9121fd7b8cbd43b28318265031a1725f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b" is_pre_election: true
I20260929 06:39:04.135490 26489 raft_consensus.cc:2454] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9121fd7b8cbd43b28318265031a1725f in term 0.
I20260929 06:39:04.135599 26355 raft_consensus.cc:2454] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9121fd7b8cbd43b28318265031a1725f in term 0.
I20260929 06:39:04.135726 26556 leader_election.cc:302] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d1d1ad5cd4e406d88dcab3408ecd067, 9121fd7b8cbd43b28318265031a1725f; no voters:
I20260929 06:39:04.135867 26689 raft_consensus.cc:2781] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:39:04.135922 26689 raft_consensus.cc:482] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:39:04.135954 26689 raft_consensus.cc:3037] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:39:04.136639 26689 raft_consensus.cc:504] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9121fd7b8cbd43b28318265031a1725f" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36617 } } peers { permanent_uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46401 } } peers { permanent_uuid: "8d1d1ad5cd4e406d88dcab3408ecd067" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 44125 } }
I20260929 06:39:04.136775 26689 leader_election.cc:288] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [CANDIDATE]: Term 1 election: Requested vote from peers 0e6c4e85514842c28dd3d86cdb5d1e5b (127.15.157.129:46401), 8d1d1ad5cd4e406d88dcab3408ecd067 (127.15.157.130:44125)
I20260929 06:39:04.136963 26489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cdb61f5d8e4400abd5c3f41211bf2c2" candidate_uuid: "9121fd7b8cbd43b28318265031a1725f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d1d1ad5cd4e406d88dcab3408ecd067"
I20260929 06:39:04.137023 26489 raft_consensus.cc:3037] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:39:04.137006 26355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cdb61f5d8e4400abd5c3f41211bf2c2" candidate_uuid: "9121fd7b8cbd43b28318265031a1725f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b"
I20260929 06:39:04.137076 26355 raft_consensus.cc:3037] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:39:04.137766 26489 raft_consensus.cc:2454] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9121fd7b8cbd43b28318265031a1725f in term 1.
I20260929 06:39:04.137835 26355 raft_consensus.cc:2454] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9121fd7b8cbd43b28318265031a1725f in term 1.
I20260929 06:39:04.137970 26556 leader_election.cc:302] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d1d1ad5cd4e406d88dcab3408ecd067, 9121fd7b8cbd43b28318265031a1725f; no voters:
I20260929 06:39:04.138072 26689 raft_consensus.cc:2781] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:39:04.138245 26689 raft_consensus.cc:686] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [term 1 LEADER]: Becoming Leader. State: Replica: 9121fd7b8cbd43b28318265031a1725f, State: Running, Role: LEADER
I20260929 06:39:04.138341 26689 consensus_queue.cc:237] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9121fd7b8cbd43b28318265031a1725f" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36617 } } peers { permanent_uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46401 } } peers { permanent_uuid: "8d1d1ad5cd4e406d88dcab3408ecd067" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 44125 } }
I20260929 06:39:04.139168 26209 catalog_manager.cc:5495] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9121fd7b8cbd43b28318265031a1725f (127.15.157.131). New cstate: current_term: 1 leader_uuid: "9121fd7b8cbd43b28318265031a1725f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9121fd7b8cbd43b28318265031a1725f" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d1d1ad5cd4e406d88dcab3408ecd067" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 44125 } health_report { overall_health: UNKNOWN } } }
I20260929 06:39:04.169399 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:04.166985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48788 (local address 127.15.157.131:36617)
0929 06:39:04.167033 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:04.167035 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:04.167048 (+ 13us) server_negotiation.cc:407] Connection header received
0929 06:39:04.167087 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:04.167088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:04.167107 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:04.167194 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:39:04.167330 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:04.167825 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:04.168611 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:04.168813 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:04.168886 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:04.169060 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:39:04.169164 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:39:04.169258 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:04.169277 (+ 19us) server_negotiation.cc:299] Negotiation successful
0929 06:39:04.169296 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:39:04.171205 26489 raft_consensus.cc:1261] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067 [term 1 FOLLOWER]: Refusing update from remote peer 9121fd7b8cbd43b28318265031a1725f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:39:04.171242 26355 raft_consensus.cc:1261] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b [term 1 FOLLOWER]: Refusing update from remote peer 9121fd7b8cbd43b28318265031a1725f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:39:04.171546 26693 consensus_queue.cc:1035] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d1d1ad5cd4e406d88dcab3408ecd067" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:39:04.171689 26689 consensus_queue.cc:1035] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e6c4e85514842c28dd3d86cdb5d1e5b" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:39:04.174587 26697 mvcc.cc:205] Tried to move back new op lower bound from 7334559515322490880 to 7334559515191189504. Current Snapshot: MvccSnapshot[applied={T|T < 7334559515322490880}]
I20260929 06:39:04.176075 26209 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:39:04.176167 26209 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:39:04.176905 26209 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 810c495160f041caa2051067ac75ae21: Sending DeleteTablet for 3 replicas of tablet 0cdb61f5d8e4400abd5c3f41211bf2c2
I20260929 06:39:04.177255 26469 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cdb61f5d8e4400abd5c3f41211bf2c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:39:04 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:38658
I20260929 06:39:04.177299 26603 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cdb61f5d8e4400abd5c3f41211bf2c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:39:04 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:48778
I20260929 06:39:04.177490 26707 tablet_replica.cc:330] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f: stopping tablet replica
I20260929 06:39:04.177487 26335 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cdb61f5d8e4400abd5c3f41211bf2c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:39:04 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:38994
I20260929 06:39:04.177590 26707 raft_consensus.cc:2229] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:39:04.177709 26707 raft_consensus.cc:2258] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:39:04.177706 26708 tablet_replica.cc:330] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b: stopping tablet replica
I20260929 06:39:04.177834 26706 tablet_replica.cc:330] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067: stopping tablet replica
I20260929 06:39:04.177851 26708 raft_consensus.cc:2229] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:39:04.177906 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 26272
I20260929 06:39:04.177924 26706 raft_consensus.cc:2229] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:39:04.178097 26708 raft_consensus.cc:2258] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 0e6c4e85514842c28dd3d86cdb5d1e5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:39:04.179520 26706 raft_consensus.cc:2258] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:39:04.179970 26706 ts_tablet_manager.cc:1905] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:39:04.181974 26706 ts_tablet_manager.cc:1918] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:39:04.182076 26706 log.cc:1196] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/0cdb61f5d8e4400abd5c3f41211bf2c2
I20260929 06:39:04.182323 26706 ts_tablet_manager.cc:1939] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 8d1d1ad5cd4e406d88dcab3408ecd067: Deleting consensus metadata
I20260929 06:39:04.183027 26194 catalog_manager.cc:4841] TS 8d1d1ad5cd4e406d88dcab3408ecd067 (127.15.157.130:44125): tablet 0cdb61f5d8e4400abd5c3f41211bf2c2 (table test-table [id=b403f839ccf0441ba87888f97cfc902e]) successfully deleted
W20260929 06:39:04.184352 26197 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:46401 (error 108)
I20260929 06:39:04.184549 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 26406
I20260929 06:39:04.185186 26680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:04.184744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:46401 (local address 127.0.0.1:38998)
0929 06:39:04.185113 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:04.185148 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:46401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349}
W20260929 06:39:04.185494 26197 catalog_manager.cc:4584] TS 0e6c4e85514842c28dd3d86cdb5d1e5b (127.15.157.129:46401): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0cdb61f5d8e4400abd5c3f41211bf2c2: Network error: Client connection negotiation failed: client connection to 127.15.157.129:46401: connect: Connection refused (error 111)
I20260929 06:39:04.189651 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 26540
I20260929 06:39:04.189742 26707 ts_tablet_manager.cc:1905] T 0cdb61f5d8e4400abd5c3f41211bf2c2 P 9121fd7b8cbd43b28318265031a1725f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:39:04.193439 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 26178
I20260929 06:39:04.193641 26680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:04.193455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:36617 (local address 127.0.0.1:48796)
0929 06:39:04.193580 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:04.193611 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.131:36617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
2026-09-29T06:39:04Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2177 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:39:04 dist-test-slave-ltw5 krb5kdc[26712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:39:04 dist-test-slave-ltw5 krb5kdc[26712](info): set up 2 sockets
Sep 29 06:39:04 dist-test-slave-ltw5 krb5kdc[26712](info): commencing operation
krb5kdc: starting...
W20260929 06:39:05.226948 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:39:05 dist-test-slave-ltw5 krb5kdc[26712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:39:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:39:05Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.15.157.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.15.157.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/rangeradmin_127.15.157.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/rangeradmin_127.15.157.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.15.157.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.15.157.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/rangerlookup_127.15.157.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/rangerlookup_127.15.157.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.157.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.15.157.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/HTTP_127.15.157.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/HTTP_127.15.157.148@KRBTEST.COM.keytab.
I20260929 06:39:05.384125 15990 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taska4I_r0/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/postgres -l logfile start
2026-09-29 06:39:07.849 UTC [26742] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-29 06:39:07.849 UTC [26742] LOG: listening on IPv4 address "127.15.157.148", port 42539
2026-09-29 06:39:07.853 UTC [26742] LOG: listening on Unix socket "/tmp/.s.PGSQL.42539"
2026-09-29 06:39:07.888 UTC [26745] LOG: database system was shut down at 2026-09-29 06:39:06 UTC
2026-09-29 06:39:07.892 UTC [26742] LOG: database system is ready to accept connections
I20260929 06:39:08.834991 15990 mini_postgres.cc:96] Postgres bound to 42539
2026-09-29 06:39:08.841 UTC [26753] FATAL: database "slave" does not exist
127.15.157.148:42539 - accepting connections
I20260929 06:39:08.841651 15990 mini_ranger.cc:161] Starting Ranger...
I20260929 06:39:08.855901 15990 mini_ranger.cc:84] Created miniranger Postgres user
I20260929 06:39:09.339959 15990 mini_ranger.cc:87] Created ranger Postgres database
I20260929 06:39:09.340058 15990 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-admin
2026-09-29 06:39:09,622 [I] DB FLAVOR :POSTGRES
2026-09-29 06:39:09,622 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 06:39:09,622 [I] Checking connection..
2026-09-29 06:39:09,623 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-29 06:39:09,853 [I] Checking connection passed.
2026-09-29 06:39:09,853 [I] --------- Verifying version history table ---------
2026-09-29 06:39:09,854 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 06:39:10,084 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 06:39:10,085 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 06:39:10,327 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 06:39:10,328 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-29 06:39:10,328 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-29 06:39:10.581 UTC [26817] WARNING: there is no transaction in progress
2026-09-29 06:39:10,587 [I] create_dbversion_catalog.sql file imported successfully
2026-09-29 06:39:10,587 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 06:39:10,813 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-29 06:39:10,813 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 06:39:10,813 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-29 06:39:11,039 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-29 06:39:11,266 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-ltw5.c.gcp-upstream.internal','N') ;"
2026-09-29 06:39:11,485 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 06:39:11,712 [I] Table x_portal_user does not exist in database ranger
2026-09-29 06:39:11,712 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 06:39:11,941 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-29 06:39:11,941 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 06:39:12,179 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 06:39:12,424 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-29 06:39:12,425 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-29 06:39:13.409 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.425 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.442 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.458 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.477 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.496 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.558 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.565 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.580 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.590 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.601 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.615 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.625 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.632 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.639 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:13.646 UTC [26925] WARNING: there is no transaction in progress
2026-09-29 06:39:14,297 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-29 06:39:14,297 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-29 06:39:14,553 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-29 06:39:14,553 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 06:39:14,806 [I] Table x_portal_user already exists in database 'ranger'
2026-09-29 06:39:14,807 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 06:39:15,048 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-29 06:39:15,049 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 06:39:15,294 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 06:39:15,551 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-ltw5.c.gcp-upstream.internal';"
2026-09-29 06:39:15,764 [I] CORE_DB_SCHEMA import status has been updated
2026-09-29 06:39:15,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-29 06:39:15,992 [I] DB_PATCHES have already been applied
I20260929 06:39:15.998505 15990 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-admin:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taska4I_r0/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260929 06:39:15.998569 15990 mini_ranger.cc:193] Using host: 127.15.157.148
I20260929 06:39:16.001499 15990 mini_ranger.cc:227] Ranger admin URL: http://127.15.157.148:42841
Sep 29, 2026 6:39:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 6:39:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 6:39:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-admin/ews/webapp
Sep 29, 2026 6:39:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 29, 2026 6:39:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 29, 2026 6:39:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-admin/ews/webapp].
Sep 29, 2026 6:39:16 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260929 06:39:17.092159 15990 mini_ranger.cc:160] Time spent starting Ranger: real 8.251s user 0.000s sys 0.008s
Sep 29, 2026 6:39:35 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 29, 2026 6:39:36 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Sep 29, 2026 6:39:36 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 29, 2026 6:39:36 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 29, 2026 6:39:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 29, 2026 6:39:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 29, 2026 6:39:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 29, 2026 6:39:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 29, 2026 6:39:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 29, 2026 6:39:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 29, 2026 6:39:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 29, 2026 6:39:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 29, 2026 6:39:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 29, 2026 6:39:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 29, 2026 6:39:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 29, 2026 6:39:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 29, 2026 6:39:36 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 29, 2026 6:39:37 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260929 06:39:37.538228 15990 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.15.157.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.15.157.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/rangerkms_127.15.157.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/rangerkms_127.15.157.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.157.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.15.157.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.157.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/HTTP_127.15.157.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.157.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/HTTP_127.15.157.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 29 06:39:37 dist-test-slave-ltw5 krb5kdc[26712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663977, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260929 06:39:37.636420 15990 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260929 06:39:37.646514 15990 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260929 06:39:38.534742 15990 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260929 06:39:38.534832 15990 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-kms
I20260929 06:39:38.534853 15990 mini_ranger_kms.cc:227] Using postgres at 127.15.157.148:42539
2026-09-29 06:39:38,716 [I] DB FLAVOR :POSTGRES
2026-09-29 06:39:38,716 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 06:39:38,716 [I] Checking connection
2026-09-29 06:39:38,716 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-29 06:39:38,956 [I] connection success
2026-09-29 06:39:38,957 [I] --------- Verifying Ranger DB tables ---------
2026-09-29 06:39:38,957 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-29 06:39:38,957 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-29 06:39:39,214 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-29 06:39:39,214 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 06:39:39,214 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-29 06:39:39,214 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:42539/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-29 06:39:39,482 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260929 06:39:39.920681 15990 mini_ranger_kms.cc:310] Created kms service
I20260929 06:39:40.080508 15990 mini_ranger_kms.cc:326] Created kudu user
I20260929 06:39:40.129215 15990 mini_ranger_kms.cc:343] Created rangerkms user
Sep 29 06:39:40 dist-test-slave-ltw5 krb5kdc[26712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663977, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:39:40.564141 15990 mini_ranger_kms.cc:384] Added ranger policy
I20260929 06:39:40.564270 15990 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-kms:/tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260929 06:39:40.564292 15990 mini_ranger_kms.cc:240] Using host: 127.15.157.148
I20260929 06:39:40.567668 15990 mini_ranger_kms.cc:276] Ranger KMS PID: 27105
I20260929 06:39:40.567807 15990 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.15.157.148:35535
Sep 29, 2026 6:39:41 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 6:39:41 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 6:39:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 29, 2026 6:39:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 29, 2026 6:39:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-kms/ews/webapp].
Sep 29, 2026 6:39:42 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260929 06:39:42.800909 15990 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.164s user 0.004s sys 0.160s
I20260929 06:39:42.801021 15990 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260929 06:39:42.801100 15990 mini_ranger_kms.cc:401] 127.15.157.148:35535/kms/v1/keys
Sep 29 06:39:42 dist-test-slave-ltw5 krb5kdc[26712](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790663982, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.157.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 29 06:39:43 dist-test-slave-ltw5 krb5kdc[26712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663982, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.157.148@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
Sep 29 06:39:43 dist-test-slave-ltw5 krb5kdc[26712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663982, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.157.148@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
Sep 29 06:39:45 dist-test-slave-ltw5 krb5kdc[26712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:39:45.861172 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:46041
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:46041
--ranger_config_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.157.148:35535/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:39:45.942152 27156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:45.942366 27156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:45.942396 27156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:45.943590 27156 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:39:45.943634 27156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:45.943647 27156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:45.943703 27156 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:39:45.943720 27156 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:39:45.945422 27156 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/wal
--ranger_kms_url=127.15.157.148:35535/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:46041
--ranger_config_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:46041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:45.945683 27156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:45.945930 27156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:39:45.951097 27156 server_base.cc:1034] running on GCE node
W20260929 06:39:45.951134 27164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:45.951134 27162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:45.951184 27161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:45.951598 27156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:45.951924 27156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:45.953085 27156 hybrid_clock.cc:648] HybridClock initialized: now 1790663985953073 us; error 46 us; skew 500 ppm
Sep 29 06:39:45 dist-test-slave-ltw5 krb5kdc[26712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663985, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:39:45.960932 27156 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:39:45.961396 27156 webserver.cc:460] Webserver started at http://127.15.157.190:41581/ using document root <none> and password file <none>
I20260929 06:39:45.961632 27156 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:45.961694 27156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:45.961853 27156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:39:45 dist-test-slave-ltw5 krb5kdc[26712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663985, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:39:46.017275 27156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "e25ec86c7fb14896be0e4d992f01c50b"
format_stamp: "Formatted at 2026-09-29 06:39:46 on dist-test-slave-ltw5"
server_key: "2692411f2c992f7dee42b60d740466eb"
server_key_iv: "110fd239331d6f029d749f911bcbd365"
server_key_version: "kuduclusterkey@0"
I20260929 06:39:46.017769 27156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "e25ec86c7fb14896be0e4d992f01c50b"
format_stamp: "Formatted at 2026-09-29 06:39:46 on dist-test-slave-ltw5"
server_key: "2692411f2c992f7dee42b60d740466eb"
server_key_iv: "110fd239331d6f029d749f911bcbd365"
server_key_version: "kuduclusterkey@0"
I20260929 06:39:46.019673 27156 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260929 06:39:46.033921 27171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:46.034190 27156 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:39:46.034291 27156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "e25ec86c7fb14896be0e4d992f01c50b"
format_stamp: "Formatted at 2026-09-29 06:39:46 on dist-test-slave-ltw5"
server_key: "2692411f2c992f7dee42b60d740466eb"
server_key_iv: "110fd239331d6f029d749f911bcbd365"
server_key_version: "kuduclusterkey@0"
I20260929 06:39:46.034391 27156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:46.050720 27156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:46.052937 27156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:46.053097 27156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:46.058642 27156 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:46041
I20260929 06:39:46.058666 27223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:46041 every 8 connection(s)
I20260929 06:39:46.059093 27156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:39:46.059808 27224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:39:46.062101 27224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b: Bootstrap starting.
I20260929 06:39:46.062683 27224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b: Neither blocks nor log segments found. Creating new log.
I20260929 06:39:46.062992 27224 log.cc:824] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b: Log is configured to *not* fsync() on all Append() calls
I20260929 06:39:46.063690 27224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b: No bootstrap required, opened a new log
I20260929 06:39:46.065690 27224 raft_consensus.cc:348] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e25ec86c7fb14896be0e4d992f01c50b" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46041 } }
I20260929 06:39:46.065858 27224 raft_consensus.cc:374] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:39:46.065904 27224 raft_consensus.cc:729] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e25ec86c7fb14896be0e4d992f01c50b, State: Initialized, Role: FOLLOWER
I20260929 06:39:46.066148 27224 consensus_queue.cc:260] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e25ec86c7fb14896be0e4d992f01c50b" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46041 } }
I20260929 06:39:46.066253 27224 raft_consensus.cc:388] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:39:46.066298 27224 raft_consensus.cc:482] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:39:46.066346 27224 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:39:46.066866 27224 raft_consensus.cc:504] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e25ec86c7fb14896be0e4d992f01c50b" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46041 } }
I20260929 06:39:46.066991 27224 leader_election.cc:302] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e25ec86c7fb14896be0e4d992f01c50b; no voters:
I20260929 06:39:46.067211 27224 leader_election.cc:288] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:39:46.067217 27227 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:39:46.067382 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 27156
I20260929 06:39:46.067408 27227 raft_consensus.cc:686] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [term 1 LEADER]: Becoming Leader. State: Replica: e25ec86c7fb14896be0e4d992f01c50b, State: Running, Role: LEADER
I20260929 06:39:46.067482 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:39:46.067492 27227 consensus_queue.cc:237] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e25ec86c7fb14896be0e4d992f01c50b" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46041 } }
I20260929 06:39:46.067516 27224 sys_catalog.cc:564] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:39:46.067659 15990 external_mini_cluster.cc:1428] Setting key 0cb86b3506b30557c4689c275e2e4cc1
I20260929 06:39:46.067783 27227 sys_catalog.cc:455] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e25ec86c7fb14896be0e4d992f01c50b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e25ec86c7fb14896be0e4d992f01c50b" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46041 } } }
I20260929 06:39:46.068305 27227 sys_catalog.cc:458] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [sys.catalog]: This master's current role is: LEADER
I20260929 06:39:46.068452 27227 sys_catalog.cc:455] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e25ec86c7fb14896be0e4d992f01c50b. Latest consensus state: current_term: 1 leader_uuid: "e25ec86c7fb14896be0e4d992f01c50b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e25ec86c7fb14896be0e4d992f01c50b" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46041 } } }
I20260929 06:39:46.068532 27227 sys_catalog.cc:458] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b [sys.catalog]: This master's current role is: LEADER
I20260929 06:39:46.068674 27238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:39:46.069218 27238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:39:46.069537 27224 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Sep 29 06:39:46 dist-test-slave-ltw5 krb5kdc[26712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:39:46.082549 27235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:46.068126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35384 (local address 127.15.157.190:46041)
0929 06:39:46.069310 (+ 1184us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:46.069319 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:46.069350 (+ 31us) server_negotiation.cc:407] Connection header received
0929 06:39:46.069470 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:46.069477 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:46.069534 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:46.070479 (+ 945us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:46.070590 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:46.071506 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:46.073385 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:46.075086 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:46.075239 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:46.078268 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:46.078272 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:46.078273 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:39:46.078285 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:46.080544 (+ 2259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:46.080979 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:46.080982 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:46.080982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:46.081099 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:46.081343 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:46.081344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:46.081345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:46.081708 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:46.081867 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:46.082161 (+ 294us) server_negotiation.cc:299] Negotiation successful
0929 06:39:46.082291 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1127,"thread_start_us":86,"threads_started":1}
I20260929 06:39:46.086519 27238 catalog_manager.cc:1347] Generated new cluster ID: c8f2b816f68547be9b4611aa0b033317
I20260929 06:39:46.086606 27238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:39:46.110910 27238 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:39:46.111742 27238 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:39:46.119946 27238 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b: Generated new TSK 0
I20260929 06:39:46.120213 27238 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:39:46.840682 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.157.148:35535/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46041
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:39:46.955319 27269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:46.955579 27269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:46.955617 27269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:46.956759 27269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:46.956825 27269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:46.956869 27269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:39:46.958549 27269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.15.157.148:35535/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:46.958781 27269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:46.959015 27269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:46.966082 27277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:46.966082 27275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:46.966332 27269 server_base.cc:1034] running on GCE node
W20260929 06:39:46.966131 27274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:46.966550 27269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:46.966806 27269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:46.967985 27269 hybrid_clock.cc:648] HybridClock initialized: now 1790663986967959 us; error 37 us; skew 500 ppm
Sep 29 06:39:46 dist-test-slave-ltw5 krb5kdc[26712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663986, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:39:46.971208 27269 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:39:46.971696 27269 webserver.cc:460] Webserver started at http://127.15.157.129:44559/ using document root <none> and password file <none>
I20260929 06:39:46.971920 27269 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:46.971989 27269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:46.972138 27269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:39:46 dist-test-slave-ltw5 krb5kdc[26712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663986, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:39:46.988655 27269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "d2c457030e2c4645aa771566adf878c5"
format_stamp: "Formatted at 2026-09-29 06:39:46 on dist-test-slave-ltw5"
server_key: "d1164321552a166aa3d19a3c5821d1a7"
server_key_iv: "80e890e23f95d20dd6c80ec983b2ab4d"
server_key_version: "kuduclusterkey@0"
I20260929 06:39:46.989122 27269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "d2c457030e2c4645aa771566adf878c5"
format_stamp: "Formatted at 2026-09-29 06:39:46 on dist-test-slave-ltw5"
server_key: "d1164321552a166aa3d19a3c5821d1a7"
server_key_iv: "80e890e23f95d20dd6c80ec983b2ab4d"
server_key_version: "kuduclusterkey@0"
I20260929 06:39:46.994462 27269 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.000s
I20260929 06:39:47.010161 27286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:47.010389 27269 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260929 06:39:47.010493 27269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "d2c457030e2c4645aa771566adf878c5"
format_stamp: "Formatted at 2026-09-29 06:39:46 on dist-test-slave-ltw5"
server_key: "d1164321552a166aa3d19a3c5821d1a7"
server_key_iv: "80e890e23f95d20dd6c80ec983b2ab4d"
server_key_version: "kuduclusterkey@0"
I20260929 06:39:47.010589 27269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:47.028901 27269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:47.031755 27269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:47.031920 27269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:47.032174 27269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:39:47.032543 27269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:39:47.032595 27269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:47.032626 27269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:39:47.032685 27269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:47.040563 27269 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:46505
I20260929 06:39:47.040694 27399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:46505 every 8 connection(s)
I20260929 06:39:47.041072 27269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:39:47.044945 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 27269
I20260929 06:39:47.045048 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:39:47.045229 15990 external_mini_cluster.cc:1428] Setting key fb3c690b7f003c4089fbb016720bfb8d
Sep 29 06:39:47 dist-test-slave-ltw5 krb5kdc[26712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663986, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:39:47.052172 27403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.041936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:55811 (local address 127.15.157.190:46041)
0929 06:39:47.042210 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:47.042213 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:47.042224 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:39:47.042761 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:47.042762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:47.042777 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:47.042842 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:47.043399 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.043902 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.045666 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.045963 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.046644 (+ 681us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.048499 (+ 1855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:47.048500 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:47.048501 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:39:47.048508 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:47.050452 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:47.050956 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:47.050958 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:47.050958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:47.051030 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:47.051342 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:47.051343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:47.051344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:47.051497 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:47.051579 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:47.051916 (+ 337us) server_negotiation.cc:299] Negotiation successful
0929 06:39:47.052021 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":122,"threads_started":1}
I20260929 06:39:47.052284 27402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.041900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46041 (local address 127.15.157.129:55811)
0929 06:39:47.042108 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:47.042149 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:47.042643 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:47.042917 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:47.042921 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:47.043100 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:39:47.043285 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.043290 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.044003 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.044004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.045562 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.045565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.046086 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.046088 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.046233 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.046899 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:39:47.046909 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:39:47.048398 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:39:47.050547 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:39:47.050554 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:39:47.050556 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:39:47.050857 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:39:47.051115 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:39:47.051116 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:39:47.051117 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:39:47.051259 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:39:47.051584 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:39:47.051590 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:39:47.051752 (+ 162us) client_negotiation.cc:769] Sending connection context
0929 06:39:47.051879 (+ 127us) client_negotiation.cc:240] Negotiation successful
0929 06:39:47.052047 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":134,"threads_started":1}
I20260929 06:39:47.053122 27400 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46041
I20260929 06:39:47.053225 27400 heartbeater.cc:464] Registering TS with master...
I20260929 06:39:47.053413 27400 heartbeater.cc:511] Master 127.15.157.190:46041 requested a full tablet report, sending...
I20260929 06:39:47.054069 27188 ts_manager.cc:194] Registered new tserver with Master: d2c457030e2c4645aa771566adf878c5 (127.15.157.129:46505)
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
I20260929 06:39:47.055044 27188 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:55811
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:39:47.077512 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.157.148:35535/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46041
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 06:39:47 dist-test-slave-ltw5 krb5kdc[26712](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790663987, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260929 06:39:47.197124 27406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:47.197474 27406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:47.197567 27406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:47.199375 27406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:47.199438 27406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:47.199478 27406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:39:47.202157 27406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.15.157.148:35535/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:47.202409 27406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:47.202719 27406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:47.210979 27414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:47.211104 27413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:47.210983 27416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:47.211796 27406 server_base.cc:1034] running on GCE node
I20260929 06:39:47.212111 27406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:47.212369 27406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:47.213536 27406 hybrid_clock.cc:648] HybridClock initialized: now 1790663987213506 us; error 41 us; skew 500 ppm
Sep 29 06:39:47 dist-test-slave-ltw5 krb5kdc[26712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663987, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:39:47.216930 27406 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:39:47.217453 27406 webserver.cc:460] Webserver started at http://127.15.157.130:35989/ using document root <none> and password file <none>
I20260929 06:39:47.217712 27406 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:47.217767 27406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:47.217891 27406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:39:47 dist-test-slave-ltw5 krb5kdc[26712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663987, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:39:47.231746 27406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "334473d5be9e44f3a3c13ca89ea0913a"
format_stamp: "Formatted at 2026-09-29 06:39:47 on dist-test-slave-ltw5"
server_key: "b2e1d4ad3e49d4f95b812c33a67cd912"
server_key_iv: "b668689a02da12ee7d474a60c239996b"
server_key_version: "kuduclusterkey@0"
I20260929 06:39:47.232255 27406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "334473d5be9e44f3a3c13ca89ea0913a"
format_stamp: "Formatted at 2026-09-29 06:39:47 on dist-test-slave-ltw5"
server_key: "b2e1d4ad3e49d4f95b812c33a67cd912"
server_key_iv: "b668689a02da12ee7d474a60c239996b"
server_key_version: "kuduclusterkey@0"
I20260929 06:39:47.235816 27406 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260929 06:39:47.251938 27423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:47.252696 27406 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260929 06:39:47.252810 27406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "334473d5be9e44f3a3c13ca89ea0913a"
format_stamp: "Formatted at 2026-09-29 06:39:47 on dist-test-slave-ltw5"
server_key: "b2e1d4ad3e49d4f95b812c33a67cd912"
server_key_iv: "b668689a02da12ee7d474a60c239996b"
server_key_version: "kuduclusterkey@0"
I20260929 06:39:47.252931 27406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:47.275964 27406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:47.278666 27406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:47.278867 27406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:47.279124 27406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:39:47.279546 27406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:39:47.279637 27406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:47.279712 27406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:39:47.279773 27406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:47.286295 27406 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:39161
I20260929 06:39:47.286758 27406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:39:47.288772 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 27406
I20260929 06:39:47.288878 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:39:47.289065 15990 external_mini_cluster.cc:1428] Setting key 98cbfe871463fed371ab06198c56f338
I20260929 06:39:47.298898 27537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:39161 every 8 connection(s)
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Sep 29 06:39:47 dist-test-slave-ltw5 krb5kdc[26712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663987, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:39:47.324388 27403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.299853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:54157 (local address 127.15.157.190:46041)
0929 06:39:47.299897 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:47.299899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:47.312801 (+ 12902us) server_negotiation.cc:407] Connection header received
0929 06:39:47.313739 (+ 938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:47.313741 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:47.313758 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:47.313823 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:47.314637 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.316308 (+ 1671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.317872 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.318234 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.318312 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.320955 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:47.320956 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:47.320957 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:39:47.320965 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:47.322747 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:47.323252 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:47.323253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:47.323253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:47.323313 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:47.323617 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:47.323618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:47.323618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:47.323757 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:47.323803 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:47.324190 (+ 387us) server_negotiation.cc:299] Negotiation successful
0929 06:39:47.324287 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:39:47.325199 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.299568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46041 (local address 127.15.157.130:54157)
0929 06:39:47.312577 (+ 13009us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:47.312681 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:47.313616 (+ 935us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:47.313918 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:47.313921 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:47.314211 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:39:47.314511 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.314518 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.316438 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.316439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.317755 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.317758 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.318386 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.318387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.318534 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.319139 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:39:47.319149 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:39:47.320828 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:39:47.322856 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:39:47.322863 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:39:47.322865 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:39:47.323157 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:39:47.323389 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:39:47.323390 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:39:47.323390 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:39:47.323534 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:39:47.323867 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:39:47.323873 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:39:47.324033 (+ 160us) client_negotiation.cc:769] Sending connection context
0929 06:39:47.324764 (+ 731us) client_negotiation.cc:240] Negotiation successful
0929 06:39:47.324952 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12913,"thread_start_us":99,"threads_started":1}
I20260929 06:39:47.325877 27538 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46041
I20260929 06:39:47.325984 27538 heartbeater.cc:464] Registering TS with master...
I20260929 06:39:47.326206 27538 heartbeater.cc:511] Master 127.15.157.190:46041 requested a full tablet report, sending...
I20260929 06:39:47.326563 27188 ts_manager.cc:194] Registered new tserver with Master: 334473d5be9e44f3a3c13ca89ea0913a (127.15.157.130:39161)
I20260929 06:39:47.327049 27188 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:54157
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:39:47.338776 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.157.148:35535/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46041
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:39:47.460908 27543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:39:47.461189 27543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:39:47.461227 27543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:39:47.462989 27543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:39:47.463050 27543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:39:47.463088 27543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:39:47.465209 27543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.15.157.148:35535/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:39:47.465476 27543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:39:47.465858 27543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:39:47.472122 27549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:47.472122 27548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:39:47.472209 27551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:39:47.472985 27543 server_base.cc:1034] running on GCE node
I20260929 06:39:47.473203 27543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:39:47.473492 27543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:39:47.474660 27543 hybrid_clock.cc:648] HybridClock initialized: now 1790663987474639 us; error 36 us; skew 500 ppm
Sep 29 06:39:47 dist-test-slave-ltw5 krb5kdc[26712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663987, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:39:47.478451 27543 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:39:47.478971 27543 webserver.cc:460] Webserver started at http://127.15.157.131:36525/ using document root <none> and password file <none>
I20260929 06:39:47.479236 27543 fs_manager.cc:359] Metadata directory not provided
I20260929 06:39:47.479298 27543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:39:47.479496 27543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:39:47 dist-test-slave-ltw5 krb5kdc[26712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663987, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:39:47.492815 27543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "3e7c1a2c72db4abcb25822db22e597c4"
format_stamp: "Formatted at 2026-09-29 06:39:47 on dist-test-slave-ltw5"
server_key: "381e95b958bdcbb22ad6d25432590d26"
server_key_iv: "e6f2f7c9e2908b1df475eea0f43ba743"
server_key_version: "kuduclusterkey@0"
I20260929 06:39:47.493346 27543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "3e7c1a2c72db4abcb25822db22e597c4"
format_stamp: "Formatted at 2026-09-29 06:39:47 on dist-test-slave-ltw5"
server_key: "381e95b958bdcbb22ad6d25432590d26"
server_key_iv: "e6f2f7c9e2908b1df475eea0f43ba743"
server_key_version: "kuduclusterkey@0"
I20260929 06:39:47.516300 27543 fs_manager.cc:691] Time spent creating directory manager: real 0.022s user 0.001s sys 0.001s
I20260929 06:39:47.542919 27558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:47.543188 27543 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.000s sys 0.001s
I20260929 06:39:47.543289 27543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "3e7c1a2c72db4abcb25822db22e597c4"
format_stamp: "Formatted at 2026-09-29 06:39:47 on dist-test-slave-ltw5"
server_key: "381e95b958bdcbb22ad6d25432590d26"
server_key_iv: "e6f2f7c9e2908b1df475eea0f43ba743"
server_key_version: "kuduclusterkey@0"
I20260929 06:39:47.543399 27543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:39:47.601509 27543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:39:47.604465 27543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:39:47.604687 27543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:39:47.604972 27543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:39:47.605408 27543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:39:47.605502 27543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:47.605576 27543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:39:47.605634 27543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:39:47.614413 27543 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:44151
I20260929 06:39:47.615188 27543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:39:47.617857 27671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:44151 every 8 connection(s)
I20260929 06:39:47.624202 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 27543
I20260929 06:39:47.624316 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:39:47.624497 15990 external_mini_cluster.cc:1428] Setting key 1234bf937297e19800fcf87e1873270c
Sep 29 06:39:47 dist-test-slave-ltw5 krb5kdc[26712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663987, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:39:47.631067 27403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.618800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:39731 (local address 127.15.157.190:46041)
0929 06:39:47.618845 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:47.618848 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:47.619384 (+ 536us) server_negotiation.cc:407] Connection header received
0929 06:39:47.620397 (+ 1013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:47.620399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:47.620412 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:47.620444 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:47.621310 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.622124 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.623618 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.623934 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.623982 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.627864 (+ 3882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:47.627865 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:47.627866 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:39:47.627873 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:47.629547 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:47.630045 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:47.630046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:47.630047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:47.630101 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:47.630370 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:47.630371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:47.630371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:47.630497 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:47.630537 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:47.630892 (+ 355us) server_negotiation.cc:299] Negotiation successful
0929 06:39:47.630972 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:39:47.631783 27674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.618482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46041 (local address 127.15.157.131:39731)
0929 06:39:47.619245 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:47.619293 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:47.620259 (+ 966us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:47.620654 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:47.620659 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:47.620919 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:39:47.621198 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.621204 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.622234 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.622235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.623516 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.623519 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.625421 (+ 1902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.625422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.625571 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.626171 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:39:47.626182 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:39:47.627760 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:39:47.629643 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:39:47.629649 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:39:47.629651 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:39:47.629939 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:39:47.630172 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:39:47.630173 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:39:47.630173 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:39:47.630300 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:39:47.630580 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:39:47.630586 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:39:47.630738 (+ 152us) client_negotiation.cc:769] Sending connection context
0929 06:39:47.631405 (+ 667us) client_negotiation.cc:240] Negotiation successful
0929 06:39:47.631559 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"thread_start_us":89,"threads_started":1}
I20260929 06:39:47.632509 27672 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46041
I20260929 06:39:47.632599 27672 heartbeater.cc:464] Registering TS with master...
I20260929 06:39:47.632771 27672 heartbeater.cc:511] Master 127.15.157.190:46041 requested a full tablet report, sending...
I20260929 06:39:47.633162 27188 ts_manager.cc:194] Registered new tserver with Master: 3e7c1a2c72db4abcb25822db22e597c4 (127.15.157.131:44151)
I20260929 06:39:47.633638 27188 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:39731
I20260929 06:39:47.635999 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:39:47.645534 27403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.637682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48060 (local address 127.15.157.190:46041)
0929 06:39:47.637717 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:47.637719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:47.638072 (+ 353us) server_negotiation.cc:407] Connection header received
0929 06:39:47.638168 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:47.638169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:47.638178 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:47.638205 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:39:47.638993 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.639757 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.640852 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.641150 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.641187 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.642681 (+ 1494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:39:47.642682 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:39:47.642682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:39:47.642689 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:39:47.644363 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:47.644752 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:47.644753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:47.644753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:47.644802 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:39:47.645002 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:39:47.645003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:39:47.645003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:39:47.645114 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:39:47.645184 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:47.645372 (+ 188us) server_negotiation.cc:299] Negotiation successful
0929 06:39:47.645443 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 06:39:47.647571 27188 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48060:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:39:47.649691 27188 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:39:47.659224 27689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.652568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:39161 (local address 127.0.0.1:35338)
0929 06:39:47.653707 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:47.653746 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:47.653812 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:47.654591 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:47.654592 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:47.654594 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:39:47.654636 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.654638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.656245 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.656246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.657479 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.657482 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.658926 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.658927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.659007 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.659021 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 06:39:47.659094 (+ 73us) client_negotiation.cc:240] Negotiation successful
0929 06:39:47.659145 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1104,"thread_start_us":64,"threads_started":1}
I20260929 06:39:47.659782 27687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.653071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35338 (local address 127.15.157.130:39161)
0929 06:39:47.654374 (+ 1303us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:47.654379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:47.654388 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:39:47.654426 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:47.654428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:47.654442 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:47.654515 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:39:47.654712 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.656155 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.657604 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.658718 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.658814 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.658875 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:47.659643 (+ 768us) server_negotiation.cc:299] Negotiation successful
0929 06:39:47.659687 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1262,"thread_start_us":80,"threads_started":1}
I20260929 06:39:47.660612 27454 tablet_service.cc:1467] Processing CreateTablet for tablet 4a31297a132f41ac8e52c56c49b145cf (DEFAULT_TABLE table=test-table [id=7695782c6e78475895bb95cdc776dc00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:39:47.661006 27454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a31297a132f41ac8e52c56c49b145cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:39:47.665625 27691 tablet_bootstrap.cc:492] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a: Bootstrap starting.
I20260929 06:39:47.665900 27686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.652767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:44151 (local address 127.0.0.1:55324)
0929 06:39:47.653862 (+ 1095us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:47.653873 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:47.653930 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:47.654301 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:47.654305 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:47.654307 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:39:47.654377 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.654378 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.655631 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.655631 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.661813 (+ 6182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.661815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.665669 (+ 3854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.665670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.665732 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.665735 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:39:47.665783 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 06:39:47.665823 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1079,"thread_start_us":51,"threads_started":1}
I20260929 06:39:47.666894 27691 tablet_bootstrap.cc:654] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a: Neither blocks nor log segments found. Creating new log.
I20260929 06:39:47.667254 27691 log.cc:824] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:39:47.667299 27688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.653222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55324 (local address 127.15.157.131:44151)
0929 06:39:47.654126 (+ 904us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:47.654130 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:47.654140 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:39:47.654179 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:47.654180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:47.654196 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:47.654277 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:39:47.654467 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.655537 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.664730 (+ 9193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.665486 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.665581 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.665634 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:47.667178 (+ 1544us) server_negotiation.cc:299] Negotiation successful
0929 06:39:47.667223 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":868,"thread_start_us":69,"threads_started":1}
I20260929 06:39:47.668286 27606 tablet_service.cc:1467] Processing CreateTablet for tablet 4a31297a132f41ac8e52c56c49b145cf (DEFAULT_TABLE table=test-table [id=7695782c6e78475895bb95cdc776dc00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:39:47.668610 27606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a31297a132f41ac8e52c56c49b145cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:39:47.673113 27692 tablet_bootstrap.cc:492] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4: Bootstrap starting.
I20260929 06:39:47.675040 27692 tablet_bootstrap.cc:654] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4: Neither blocks nor log segments found. Creating new log.
I20260929 06:39:47.675477 27691 tablet_bootstrap.cc:492] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a: No bootstrap required, opened a new log
I20260929 06:39:47.675596 27691 ts_tablet_manager.cc:1397] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260929 06:39:47.677537 27691 raft_consensus.cc:348] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "334473d5be9e44f3a3c13ca89ea0913a" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39161 } } peers { permanent_uuid: "d2c457030e2c4645aa771566adf878c5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46505 } } peers { permanent_uuid: "3e7c1a2c72db4abcb25822db22e597c4" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44151 } }
I20260929 06:39:47.677824 27691 raft_consensus.cc:374] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:39:47.677919 27691 raft_consensus.cc:729] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 334473d5be9e44f3a3c13ca89ea0913a, State: Initialized, Role: FOLLOWER
I20260929 06:39:47.678133 27691 consensus_queue.cc:260] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "334473d5be9e44f3a3c13ca89ea0913a" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39161 } } peers { permanent_uuid: "d2c457030e2c4645aa771566adf878c5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46505 } } peers { permanent_uuid: "3e7c1a2c72db4abcb25822db22e597c4" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44151 } }
I20260929 06:39:47.678517 27691 ts_tablet_manager.cc:1428] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:39:47.678680 27538 heartbeater.cc:503] Master 127.15.157.190:46041 was elected leader, sending a full tablet report...
I20260929 06:39:47.680471 27692 log.cc:824] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4: Log is configured to *not* fsync() on all Append() calls
I20260929 06:39:47.681711 27692 tablet_bootstrap.cc:492] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4: No bootstrap required, opened a new log
I20260929 06:39:47.681833 27692 ts_tablet_manager.cc:1397] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260929 06:39:47.683754 27692 raft_consensus.cc:348] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "334473d5be9e44f3a3c13ca89ea0913a" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39161 } } peers { permanent_uuid: "d2c457030e2c4645aa771566adf878c5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46505 } } peers { permanent_uuid: "3e7c1a2c72db4abcb25822db22e597c4" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44151 } }
I20260929 06:39:47.683990 27692 raft_consensus.cc:374] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:39:47.684069 27692 raft_consensus.cc:729] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e7c1a2c72db4abcb25822db22e597c4, State: Initialized, Role: FOLLOWER
I20260929 06:39:47.684244 27692 consensus_queue.cc:260] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "334473d5be9e44f3a3c13ca89ea0913a" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39161 } } peers { permanent_uuid: "d2c457030e2c4645aa771566adf878c5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46505 } } peers { permanent_uuid: "3e7c1a2c72db4abcb25822db22e597c4" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44151 } }
I20260929 06:39:47.684540 27692 ts_tablet_manager.cc:1428] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:39:47.684695 27672 heartbeater.cc:503] Master 127.15.157.190:46041 was elected leader, sending a full tablet report...
Sep 29 06:39:47 dist-test-slave-ltw5 krb5kdc[26712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663987, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:39:47.688614 27685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.653533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:46505 (local address 127.0.0.1:55064)
0929 06:39:47.655724 (+ 2191us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:47.655734 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:47.655778 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:47.678323 (+ 22545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:47.678324 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:47.678327 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:39:47.678406 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.678409 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.686219 (+ 7810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.686221 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.687413 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.687417 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.688365 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.688366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.688446 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.688452 (+ 6us) client_negotiation.cc:769] Sending connection context
0929 06:39:47.688483 (+ 31us) client_negotiation.cc:240] Negotiation successful
0929 06:39:47.688532 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2174,"thread_start_us":79,"threads_started":1}
I20260929 06:39:47.689189 27690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.659685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55064 (local address 127.15.157.129:46505)
0929 06:39:47.678121 (+ 18436us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:47.678126 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:47.678140 (+ 14us) server_negotiation.cc:407] Connection header received
0929 06:39:47.678180 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:47.678182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:47.678200 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:47.678499 (+ 299us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:39:47.678571 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.686107 (+ 7536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.687527 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.688262 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.688972 (+ 710us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.689044 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:47.689073 (+ 29us) server_negotiation.cc:299] Negotiation successful
0929 06:39:47.689119 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18392,"thread_start_us":63,"threads_started":1}
I20260929 06:39:47.689990 27334 tablet_service.cc:1467] Processing CreateTablet for tablet 4a31297a132f41ac8e52c56c49b145cf (DEFAULT_TABLE table=test-table [id=7695782c6e78475895bb95cdc776dc00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:39:47.690372 27334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a31297a132f41ac8e52c56c49b145cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:39:47.702188 27697 tablet_bootstrap.cc:492] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5: Bootstrap starting.
I20260929 06:39:47.703043 27697 tablet_bootstrap.cc:654] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5: Neither blocks nor log segments found. Creating new log.
I20260929 06:39:47.703387 27697 log.cc:824] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5: Log is configured to *not* fsync() on all Append() calls
I20260929 06:39:47.714843 27697 tablet_bootstrap.cc:492] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5: No bootstrap required, opened a new log
I20260929 06:39:47.715014 27697 ts_tablet_manager.cc:1397] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260929 06:39:47.717712 27697 raft_consensus.cc:348] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "334473d5be9e44f3a3c13ca89ea0913a" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39161 } } peers { permanent_uuid: "d2c457030e2c4645aa771566adf878c5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46505 } } peers { permanent_uuid: "3e7c1a2c72db4abcb25822db22e597c4" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44151 } }
I20260929 06:39:47.717957 27697 raft_consensus.cc:374] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:39:47.718051 27697 raft_consensus.cc:729] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c457030e2c4645aa771566adf878c5, State: Initialized, Role: FOLLOWER
I20260929 06:39:47.718271 27697 consensus_queue.cc:260] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "334473d5be9e44f3a3c13ca89ea0913a" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39161 } } peers { permanent_uuid: "d2c457030e2c4645aa771566adf878c5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46505 } } peers { permanent_uuid: "3e7c1a2c72db4abcb25822db22e597c4" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44151 } }
I20260929 06:39:47.718650 27697 ts_tablet_manager.cc:1428] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260929 06:39:47.718822 27400 heartbeater.cc:503] Master 127.15.157.190:46041 was elected leader, sending a full tablet report...
W20260929 06:39:47.792006 27401 tablet.cc:2369] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:39:47.800341 27539 tablet.cc:2369] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:39:47.869261 27673 tablet.cc:2369] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:39:47.892874 27694 raft_consensus.cc:482] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:39:47.893013 27694 raft_consensus.cc:504] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "334473d5be9e44f3a3c13ca89ea0913a" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39161 } } peers { permanent_uuid: "d2c457030e2c4645aa771566adf878c5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46505 } } peers { permanent_uuid: "3e7c1a2c72db4abcb25822db22e597c4" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44151 } }
I20260929 06:39:47.893407 27694 leader_election.cc:288] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2c457030e2c4645aa771566adf878c5 (127.15.157.129:46505), 3e7c1a2c72db4abcb25822db22e597c4 (127.15.157.131:44151)
I20260929 06:39:47.897790 27690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.893823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:35603 (local address 127.15.157.129:46505)
0929 06:39:47.893865 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:47.893867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:47.894370 (+ 503us) server_negotiation.cc:407] Connection header received
0929 06:39:47.894491 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:47.894493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:47.894503 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:47.894532 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:39:47.894740 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.895460 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.896811 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.897402 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.897453 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.897462 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:47.897675 (+ 213us) server_negotiation.cc:299] Negotiation successful
0929 06:39:47.897718 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:39:47.898370 27700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.893637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:46505 (local address 127.15.157.130:35603)
0929 06:39:47.894309 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:47.894320 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:47.894414 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:47.894609 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:47.894609 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:47.894611 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:39:47.894674 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.894676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.895555 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.895556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.896704 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.896707 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.897522 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.897522 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.897593 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.897596 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:39:47.898236 (+ 640us) client_negotiation.cc:240] Negotiation successful
0929 06:39:47.898284 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":62,"threads_started":1}
I20260929 06:39:47.899248 27354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a31297a132f41ac8e52c56c49b145cf" candidate_uuid: "334473d5be9e44f3a3c13ca89ea0913a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c457030e2c4645aa771566adf878c5" is_pre_election: true
I20260929 06:39:47.899418 27354 raft_consensus.cc:2454] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 334473d5be9e44f3a3c13ca89ea0913a in term 0.
I20260929 06:39:47.899748 27425 leader_election.cc:302] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 334473d5be9e44f3a3c13ca89ea0913a, d2c457030e2c4645aa771566adf878c5; no voters:
I20260929 06:39:47.899873 27694 raft_consensus.cc:2781] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:39:47.899915 27694 raft_consensus.cc:482] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:39:47.899937 27694 raft_consensus.cc:3037] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:39:47.900875 27694 raft_consensus.cc:504] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "334473d5be9e44f3a3c13ca89ea0913a" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39161 } } peers { permanent_uuid: "d2c457030e2c4645aa771566adf878c5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46505 } } peers { permanent_uuid: "3e7c1a2c72db4abcb25822db22e597c4" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44151 } }
I20260929 06:39:47.901000 27694 leader_election.cc:288] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [CANDIDATE]: Term 1 election: Requested vote from peers d2c457030e2c4645aa771566adf878c5 (127.15.157.129:46505), 3e7c1a2c72db4abcb25822db22e597c4 (127.15.157.131:44151)
I20260929 06:39:47.901294 27354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a31297a132f41ac8e52c56c49b145cf" candidate_uuid: "334473d5be9e44f3a3c13ca89ea0913a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c457030e2c4645aa771566adf878c5"
I20260929 06:39:47.901366 27354 raft_consensus.cc:3037] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:39:47.902359 27354 raft_consensus.cc:2454] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 334473d5be9e44f3a3c13ca89ea0913a in term 1.
I20260929 06:39:47.902576 27425 leader_election.cc:302] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 334473d5be9e44f3a3c13ca89ea0913a, d2c457030e2c4645aa771566adf878c5; no voters:
I20260929 06:39:47.902690 27694 raft_consensus.cc:2781] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:39:47.902837 27694 raft_consensus.cc:686] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [term 1 LEADER]: Becoming Leader. State: Replica: 334473d5be9e44f3a3c13ca89ea0913a, State: Running, Role: LEADER
I20260929 06:39:47.902940 27694 consensus_queue.cc:237] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "334473d5be9e44f3a3c13ca89ea0913a" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39161 } } peers { permanent_uuid: "d2c457030e2c4645aa771566adf878c5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46505 } } peers { permanent_uuid: "3e7c1a2c72db4abcb25822db22e597c4" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44151 } }
I20260929 06:39:47.903759 27187 catalog_manager.cc:5495] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a reported cstate change: term changed from 0 to 1, leader changed from <none> to 334473d5be9e44f3a3c13ca89ea0913a (127.15.157.130). New cstate: current_term: 1 leader_uuid: "334473d5be9e44f3a3c13ca89ea0913a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "334473d5be9e44f3a3c13ca89ea0913a" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2c457030e2c4645aa771566adf878c5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e7c1a2c72db4abcb25822db22e597c4" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260929 06:39:47.908277 27688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.894248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:45039 (local address 127.15.157.131:44151)
0929 06:39:47.894303 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:47.894306 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:47.904348 (+ 10042us) server_negotiation.cc:407] Connection header received
0929 06:39:47.904473 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:47.904475 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:47.904488 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:47.904537 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:39:47.904886 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.905604 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.907396 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.907920 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.907969 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.907978 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:47.908164 (+ 186us) server_negotiation.cc:299] Negotiation successful
0929 06:39:47.908202 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 06:39:47.908635 27700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.894193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:44151 (local address 127.15.157.130:45039)
0929 06:39:47.904280 (+ 10087us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:47.904293 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:39:47.904392 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:39:47.904771 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:39:47.904772 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:39:47.904773 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:39:47.904807 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.904809 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.905738 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.905739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.907285 (+ 1546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:39:47.907287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.908034 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.908035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:39:47.908091 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.908094 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:39:47.908531 (+ 437us) client_negotiation.cc:240] Negotiation successful
0929 06:39:47.908574 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10073,"thread_start_us":60,"threads_started":1}
I20260929 06:39:47.909066 27623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a31297a132f41ac8e52c56c49b145cf" candidate_uuid: "334473d5be9e44f3a3c13ca89ea0913a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e7c1a2c72db4abcb25822db22e597c4" is_pre_election: true
I20260929 06:39:47.909224 27623 raft_consensus.cc:2454] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 334473d5be9e44f3a3c13ca89ea0913a in term 0.
I20260929 06:39:47.909358 27624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a31297a132f41ac8e52c56c49b145cf" candidate_uuid: "334473d5be9e44f3a3c13ca89ea0913a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e7c1a2c72db4abcb25822db22e597c4"
I20260929 06:39:47.909426 27624 raft_consensus.cc:3037] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:39:47.910305 27624 raft_consensus.cc:2454] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 334473d5be9e44f3a3c13ca89ea0913a in term 1.
I20260929 06:39:47.944372 27687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.940939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35350 (local address 127.15.157.130:39161)
0929 06:39:47.941051 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0929 06:39:47.941053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:39:47.941061 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:39:47.941103 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:39:47.941103 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:39:47.941127 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:39:47.941199 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:39:47.941378 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.942175 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.943272 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:39:47.943590 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:39:47.943654 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:39:47.943867 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:39:47.944007 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:39:47.944086 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:39:47.944267 (+ 181us) server_negotiation.cc:299] Negotiation successful
0929 06:39:47.944289 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260929 06:39:47.947027 27624 raft_consensus.cc:1261] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4 [term 1 FOLLOWER]: Refusing update from remote peer 334473d5be9e44f3a3c13ca89ea0913a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:39:47.947063 27354 raft_consensus.cc:1261] T 4a31297a132f41ac8e52c56c49b145cf P d2c457030e2c4645aa771566adf878c5 [term 1 FOLLOWER]: Refusing update from remote peer 334473d5be9e44f3a3c13ca89ea0913a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:39:47.947393 27702 consensus_queue.cc:1035] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c457030e2c4645aa771566adf878c5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:39:47.947512 27694 consensus_queue.cc:1035] T 4a31297a132f41ac8e52c56c49b145cf P 334473d5be9e44f3a3c13ca89ea0913a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e7c1a2c72db4abcb25822db22e597c4" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:39:47.951375 27705 mvcc.cc:205] Tried to move back new op lower bound from 7334559694628241408 to 7334559694450991104. Current Snapshot: MvccSnapshot[applied={T|T < 7334559694628241408}]
I20260929 06:39:47.952992 27706 mvcc.cc:205] Tried to move back new op lower bound from 7334559694628241408 to 7334559694450991104. Current Snapshot: MvccSnapshot[applied={T|T < 7334559694628241408}]
I20260929 06:39:47.953498 27707 mvcc.cc:205] Tried to move back new op lower bound from 7334559694628241408 to 7334559694450991104. Current Snapshot: MvccSnapshot[applied={T|T < 7334559694628241408}]
I20260929 06:39:47.955188 27188 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:39:47.955274 27188 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:39:47.955992 27188 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e25ec86c7fb14896be0e4d992f01c50b: Sending DeleteTablet for 3 replicas of tablet 4a31297a132f41ac8e52c56c49b145cf
I20260929 06:39:47.956334 27334 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a31297a132f41ac8e52c56c49b145cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:39:47 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:55064
I20260929 06:39:47.956705 27606 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a31297a132f41ac8e52c56c49b145cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:39:47 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:55324
I20260929 06:39:47.957036 27454 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a31297a132f41ac8e52c56c49b145cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:39:47 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:35338
I20260929 06:39:47.957573 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 27269
I20260929 06:39:47.958417 27715 tablet_replica.cc:330] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4: stopping tablet replica
I20260929 06:39:47.958518 27715 raft_consensus.cc:2229] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:39:47.958617 27715 raft_consensus.cc:2258] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:39:47.966391 27715 ts_tablet_manager.cc:1905] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260929 06:39:47.968696 27173 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:46505 (error 108)
I20260929 06:39:47.969365 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 27406
I20260929 06:39:47.971599 27715 ts_tablet_manager.cc:1918] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:39:47.971752 27715 log.cc:1196] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/4a31297a132f41ac8e52c56c49b145cf
I20260929 06:39:47.972116 27715 ts_tablet_manager.cc:1939] T 4a31297a132f41ac8e52c56c49b145cf P 3e7c1a2c72db4abcb25822db22e597c4: Deleting consensus metadata
I20260929 06:39:47.972643 27175 catalog_manager.cc:4841] TS 3e7c1a2c72db4abcb25822db22e597c4 (127.15.157.131:44151): tablet 4a31297a132f41ac8e52c56c49b145cf (table test-table [id=7695782c6e78475895bb95cdc776dc00]) successfully deleted
I20260929 06:39:47.974670 27685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.974502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:46505 (local address 127.0.0.1:55078)
0929 06:39:47.974573 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:47.974623 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:46505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260929 06:39:47.974956 27173 catalog_manager.cc:4584] TS d2c457030e2c4645aa771566adf878c5 (127.15.157.129:46505): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4a31297a132f41ac8e52c56c49b145cf: Network error: Client connection negotiation failed: client connection to 127.15.157.129:46505: connect: Connection refused (error 111)
I20260929 06:39:47.980253 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 27543
I20260929 06:39:47.980377 27685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:39:47.980261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:39161 (local address 127.0.0.1:35352)
0929 06:39:47.980315 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 06:39:47.980342 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.130:39161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 06:39:47.985345 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 27156
I20260929 06:39:47.991981 15990 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260929 06:39:48.325964 15990 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260929 06:39:48.326117 15990 mini_ranger.cc:66] Stopping Ranger...
I20260929 06:39:48.670475 15990 mini_ranger.cc:68] Stopped Ranger
2026-09-29 06:39:48.670 UTC [26742] LOG: received smart shutdown request
2026-09-29 06:39:48.673 UTC [26742] LOG: background worker "logical replication launcher" (PID 26751) exited with exit code 1
2026-09-29 06:39:48.674 UTC [26746] LOG: shutting down
2026-09-29 06:39:48.836 UTC [26742] LOG: database system is shut down
2026-09-29T06:39:48Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (44747 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:39:49 dist-test-slave-ltw5 krb5kdc[27727](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:39:49 dist-test-slave-ltw5 krb5kdc[27727](info): set up 2 sockets
Sep 29 06:39:49 dist-test-slave-ltw5 krb5kdc[27727](info): commencing operation
krb5kdc: starting...
W20260929 06:39:49.974152 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.010s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:39:50 dist-test-slave-ltw5 krb5kdc[27727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:39:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:39:50Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.15.157.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.15.157.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/rangeradmin_127.15.157.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/rangeradmin_127.15.157.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.15.157.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.15.157.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/rangerlookup_127.15.157.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/rangerlookup_127.15.157.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.157.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.15.157.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/HTTP_127.15.157.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/HTTP_127.15.157.148@KRBTEST.COM.keytab.
I20260929 06:39:50.138974 15990 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taska4I_r0/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/postgres -l logfile start
2026-09-29 06:39:52.636 UTC [27757] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-29 06:39:52.636 UTC [27757] LOG: listening on IPv4 address "127.15.157.148", port 54521
2026-09-29 06:39:52.640 UTC [27757] LOG: listening on Unix socket "/tmp/.s.PGSQL.54521"
2026-09-29 06:39:52.660 UTC [27760] LOG: database system was shut down at 2026-09-29 06:39:51 UTC
2026-09-29 06:39:52.664 UTC [27757] LOG: database system is ready to accept connections
I20260929 06:39:53.625957 15990 mini_postgres.cc:96] Postgres bound to 54521
2026-09-29 06:39:53.632 UTC [27768] FATAL: database "slave" does not exist
127.15.157.148:54521 - accepting connections
I20260929 06:39:53.632493 15990 mini_ranger.cc:161] Starting Ranger...
I20260929 06:39:53.646776 15990 mini_ranger.cc:84] Created miniranger Postgres user
I20260929 06:39:54.105316 15990 mini_ranger.cc:87] Created ranger Postgres database
I20260929 06:39:54.105446 15990 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-admin
2026-09-29 06:39:54,392 [I] DB FLAVOR :POSTGRES
2026-09-29 06:39:54,392 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 06:39:54,393 [I] Checking connection..
2026-09-29 06:39:54,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-29 06:39:54,650 [I] Checking connection passed.
2026-09-29 06:39:54,650 [I] --------- Verifying version history table ---------
2026-09-29 06:39:54,650 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 06:39:54,893 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 06:39:54,893 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 06:39:55,149 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 06:39:55,149 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-29 06:39:55,150 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-29 06:39:55.406 UTC [27832] WARNING: there is no transaction in progress
2026-09-29 06:39:55,412 [I] create_dbversion_catalog.sql file imported successfully
2026-09-29 06:39:55,412 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 06:39:55,643 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-29 06:39:55,643 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 06:39:55,643 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-29 06:39:55,862 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-29 06:39:56,085 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-ltw5.c.gcp-upstream.internal','N') ;"
2026-09-29 06:39:56,306 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 06:39:56,561 [I] Table x_portal_user does not exist in database ranger
2026-09-29 06:39:56,561 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 06:39:56,805 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-29 06:39:56,805 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 06:39:57,061 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 06:39:57,316 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-29 06:39:57,316 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-29 06:39:58.249 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.265 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.281 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.296 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.312 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.332 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.397 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.404 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.419 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.429 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.439 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.451 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.461 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.467 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.473 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:58.480 UTC [27940] WARNING: there is no transaction in progress
2026-09-29 06:39:59,099 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-29 06:39:59,099 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-29 06:39:59,318 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-29 06:39:59,319 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 06:39:59,564 [I] Table x_portal_user already exists in database 'ranger'
2026-09-29 06:39:59,564 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 06:39:59,820 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-29 06:39:59,820 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 06:40:00,044 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 06:40:00,282 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-ltw5.c.gcp-upstream.internal';"
2026-09-29 06:40:00,518 [I] CORE_DB_SCHEMA import status has been updated
2026-09-29 06:40:00,518 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-29 06:40:00,750 [I] DB_PATCHES have already been applied
I20260929 06:40:00.756170 15990 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-admin:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taska4I_r0/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260929 06:40:00.756229 15990 mini_ranger.cc:193] Using host: 127.15.157.148
I20260929 06:40:00.759196 15990 mini_ranger.cc:227] Ranger admin URL: http://127.15.157.148:43225
Sep 29, 2026 6:40:01 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 6:40:01 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 6:40:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-admin/ews/webapp
Sep 29, 2026 6:40:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 29, 2026 6:40:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 29, 2026 6:40:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-admin/ews/webapp].
Sep 29, 2026 6:40:01 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260929 06:40:01.859704 15990 mini_ranger.cc:160] Time spent starting Ranger: real 8.227s user 0.002s sys 0.006s
Sep 29, 2026 6:40:22 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 29, 2026 6:40:22 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Sep 29, 2026 6:40:22 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 29, 2026 6:40:22 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 29, 2026 6:40:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 29, 2026 6:40:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 29, 2026 6:40:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 29, 2026 6:40:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 29, 2026 6:40:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 29, 2026 6:40:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 29, 2026 6:40:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 29, 2026 6:40:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 29, 2026 6:40:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 29, 2026 6:40:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 29, 2026 6:40:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 29, 2026 6:40:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 29, 2026 6:40:22 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 29, 2026 6:40:23 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260929 06:40:23.719568 15990 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.15.157.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.15.157.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/rangerkms_127.15.157.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.15.157.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/rangerkms_127.15.157.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.157.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.15.157.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.157.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/HTTP_127.15.157.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.157.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/HTTP_127.15.157.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 29 06:40:23 dist-test-slave-ltw5 krb5kdc[27727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664023, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260929 06:40:23.800495 15990 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260929 06:40:23.809696 15990 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260929 06:40:24.712145 15990 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260929 06:40:24.712235 15990 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-kms
I20260929 06:40:24.712258 15990 mini_ranger_kms.cc:227] Using postgres at 127.15.157.148:54521
2026-09-29 06:40:24,874 [I] DB FLAVOR :POSTGRES
2026-09-29 06:40:24,874 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 06:40:24,874 [I] Checking connection
2026-09-29 06:40:24,874 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-29 06:40:25,103 [I] connection success
2026-09-29 06:40:25,104 [I] --------- Verifying Ranger DB tables ---------
2026-09-29 06:40:25,104 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-29 06:40:25,104 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-29 06:40:25,353 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-29 06:40:25,354 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 06:40:25,354 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-29 06:40:25,354 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.157.148:54521/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-29 06:40:25,603 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260929 06:40:26.067420 15990 mini_ranger_kms.cc:310] Created kms service
I20260929 06:40:26.258649 15990 mini_ranger_kms.cc:326] Created kudu user
I20260929 06:40:26.301510 15990 mini_ranger_kms.cc:343] Created rangerkms user
Sep 29 06:40:26 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664023, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:40:26.665657 15990 mini_ranger_kms.cc:384] Added ranger policy
I20260929 06:40:26.665860 15990 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-kms:/tmp/dist-test-taska4I_r0/build/release/bin/postgresql.jar:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taska4I_r0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260929 06:40:26.665885 15990 mini_ranger_kms.cc:240] Using host: 127.15.157.148
I20260929 06:40:26.669196 15990 mini_ranger_kms.cc:276] Ranger KMS PID: 28120
I20260929 06:40:26.669282 15990 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.15.157.148:36919
Sep 29, 2026 6:40:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 6:40:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 6:40:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 29, 2026 6:40:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 29, 2026 6:40:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-kms/ews/webapp].
Sep 29, 2026 6:40:28 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260929 06:40:28.964241 15990 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.164s user 0.002s sys 0.143s
I20260929 06:40:28.964337 15990 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260929 06:40:28.964386 15990 mini_ranger_kms.cc:401] 127.15.157.148:36919/kms/v1/keys
Sep 29 06:40:29 dist-test-slave-ltw5 krb5kdc[27727](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790664029, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.157.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 29 06:40:29 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664029, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.157.148@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
Sep 29 06:40:30 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664029, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.157.148@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
Sep 29 06:40:32 dist-test-slave-ltw5 krb5kdc[27727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:40:32.361169 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:44443
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:44443
--ranger_config_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.157.148:36919/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:32.456485 28171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:32.456712 28171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:32.456754 28171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:32.457885 28171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:40:32.457952 28171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:32.457976 28171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:32.458004 28171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:40:32.458050 28171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:40:32.459589 28171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/wal
--ranger_kms_url=127.15.157.148:36919/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:44443
--ranger_config_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:44443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:32.459849 28171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:32.460059 28171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:40:32.466188 28171 server_base.cc:1034] running on GCE node
W20260929 06:40:32.466149 28179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:32.466988 28177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:32.467190 28176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:32.467464 28171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:32.467828 28171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:32.469007 28171 hybrid_clock.cc:648] HybridClock initialized: now 1790664032468995 us; error 33 us; skew 500 ppm
Sep 29 06:40:32 dist-test-slave-ltw5 krb5kdc[27727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664032, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:32.480847 28171 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:40:32.481432 28171 webserver.cc:460] Webserver started at http://127.15.157.190:43593/ using document root <none> and password file <none>
I20260929 06:40:32.481688 28171 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:32.481781 28171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:32.481961 28171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:40:32 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664032, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:40:32.533736 28171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "d0d7ccd94f294db6929e148e7684cd08"
format_stamp: "Formatted at 2026-09-29 06:40:32 on dist-test-slave-ltw5"
server_key: "35b5e191d11cf39a3c4ad0c5fdeaa48c"
server_key_iv: "25b3841674cba105b99249ebd764ad7c"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:32.534212 28171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "d0d7ccd94f294db6929e148e7684cd08"
format_stamp: "Formatted at 2026-09-29 06:40:32 on dist-test-slave-ltw5"
server_key: "35b5e191d11cf39a3c4ad0c5fdeaa48c"
server_key_iv: "25b3841674cba105b99249ebd764ad7c"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:32.536128 28171 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260929 06:40:32.551069 28186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:32.551376 28171 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:40:32.551506 28171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "d0d7ccd94f294db6929e148e7684cd08"
format_stamp: "Formatted at 2026-09-29 06:40:32 on dist-test-slave-ltw5"
server_key: "35b5e191d11cf39a3c4ad0c5fdeaa48c"
server_key_iv: "25b3841674cba105b99249ebd764ad7c"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:32.551614 28171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:32.567458 28171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:32.569592 28171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:32.569766 28171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:32.574839 28171 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:44443
I20260929 06:40:32.574926 28238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:44443 every 8 connection(s)
I20260929 06:40:32.575281 28171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:40:32.575984 28239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:32.578250 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 28171
I20260929 06:40:32.578265 28239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08: Bootstrap starting.
I20260929 06:40:32.578357 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:40:32.578553 15990 external_mini_cluster.cc:1428] Setting key 1f9fcbbbfb36d9b01660faefd7c08ea6
I20260929 06:40:32.578917 28239 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:32.579326 28239 log.cc:824] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:32.580058 28239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08: No bootstrap required, opened a new log
I20260929 06:40:32.582346 28239 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0d7ccd94f294db6929e148e7684cd08" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44443 } }
I20260929 06:40:32.582504 28239 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:32.582566 28239 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d7ccd94f294db6929e148e7684cd08, State: Initialized, Role: FOLLOWER
I20260929 06:40:32.582705 28239 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0d7ccd94f294db6929e148e7684cd08" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44443 } }
I20260929 06:40:32.582803 28239 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:40:32.582866 28239 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:40:32.582922 28239 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:40:32.583595 28239 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0d7ccd94f294db6929e148e7684cd08" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44443 } }
I20260929 06:40:32.583703 28239 leader_election.cc:302] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0d7ccd94f294db6929e148e7684cd08; no voters:
I20260929 06:40:32.583892 28239 leader_election.cc:288] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:40:32.583953 28244 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:40:32.584137 28244 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 1 LEADER]: Becoming Leader. State: Replica: d0d7ccd94f294db6929e148e7684cd08, State: Running, Role: LEADER
I20260929 06:40:32.584239 28239 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:40:32.584278 28244 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0d7ccd94f294db6929e148e7684cd08" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44443 } }
I20260929 06:40:32.584767 28244 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0d7ccd94f294db6929e148e7684cd08. Latest consensus state: current_term: 1 leader_uuid: "d0d7ccd94f294db6929e148e7684cd08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0d7ccd94f294db6929e148e7684cd08" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44443 } } }
I20260929 06:40:32.584838 28244 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:32.585014 28245 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0d7ccd94f294db6929e148e7684cd08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0d7ccd94f294db6929e148e7684cd08" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44443 } } }
I20260929 06:40:32.585129 28245 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:32.586290 28239 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260929 06:40:32.586616 28248 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Sep 29 06:40:32 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:32.589613 28248 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:40:32.594141 28242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:32.579079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49438 (local address 127.15.157.190:44443)
0929 06:40:32.579281 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:32.579290 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:32.579325 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:40:32.580035 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:32.580045 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:32.580112 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:32.580280 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:32.581054 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:32.582917 (+ 1863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:32.584053 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:32.585352 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:32.585461 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:32.588840 (+ 3379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:32.588893 (+ 53us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:32.588893 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:32.588986 (+ 93us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:32.592494 (+ 3508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:32.592865 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:32.592868 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:32.592869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:32.592961 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:32.593172 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:32.593173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:32.593174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:32.593429 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:32.593599 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:32.593667 (+ 68us) server_negotiation.cc:299] Negotiation successful
0929 06:40:32.593914 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":75,"threads_started":1}
I20260929 06:40:32.596786 28248 catalog_manager.cc:1347] Generated new cluster ID: 34da89638daf4d14afff4f85a6c4a5b1
I20260929 06:40:32.596844 28248 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:40:32.612730 28248 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:40:32.613519 28248 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:40:32.618593 28248 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08: Generated new TSK 0
I20260929 06:40:32.618794 28248 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:40:33.321043 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.157.148:36919/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:44443
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:33.409031 28284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:33.409263 28284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:33.409302 28284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:33.410497 28284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:33.410557 28284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:33.410602 28284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:40:33.412308 28284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.15.157.148:36919/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:44443
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:33.412598 28284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:33.412830 28284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:40:33.417972 28284 server_base.cc:1034] running on GCE node
W20260929 06:40:33.417992 28290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:33.418107 28289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:33.418176 28292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:33.418429 28284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:33.418676 28284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:33.419860 28284 hybrid_clock.cc:648] HybridClock initialized: now 1790664033419844 us; error 32 us; skew 500 ppm
Sep 29 06:40:33 dist-test-slave-ltw5 krb5kdc[27727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664033, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:33.422626 28284 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:40:33.423149 28284 webserver.cc:460] Webserver started at http://127.15.157.129:36807/ using document root <none> and password file <none>
I20260929 06:40:33.423430 28284 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:33.423494 28284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:33.423626 28284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:40:33 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664033, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:40:33.441820 28284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "8030b74ebca44c9488b1b7d46a4c2e68"
format_stamp: "Formatted at 2026-09-29 06:40:33 on dist-test-slave-ltw5"
server_key: "6677306cc2222d92992533e9e26205cd"
server_key_iv: "7c799fe5385e2477b83196b6eea16d3b"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:33.442489 28284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "8030b74ebca44c9488b1b7d46a4c2e68"
format_stamp: "Formatted at 2026-09-29 06:40:33 on dist-test-slave-ltw5"
server_key: "6677306cc2222d92992533e9e26205cd"
server_key_iv: "7c799fe5385e2477b83196b6eea16d3b"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:33.446478 28284 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.000s
I20260929 06:40:33.466168 28299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:33.466354 28284 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260929 06:40:33.466441 28284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "8030b74ebca44c9488b1b7d46a4c2e68"
format_stamp: "Formatted at 2026-09-29 06:40:33 on dist-test-slave-ltw5"
server_key: "6677306cc2222d92992533e9e26205cd"
server_key_iv: "7c799fe5385e2477b83196b6eea16d3b"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:33.466538 28284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:33.483891 28284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:33.486367 28284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:33.486584 28284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:33.486861 28284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:33.487303 28284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:40:33.487367 28284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:33.487401 28284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:40:33.487459 28284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:33.494261 28284 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:37077
I20260929 06:40:33.494762 28284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:40:33.500494 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 28284
I20260929 06:40:33.500625 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:40:33.500808 15990 external_mini_cluster.cc:1428] Setting key 4c5d1a46e80807b8b30f19c3c8482fe7
I20260929 06:40:33.503953 28413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:37077 every 8 connection(s)
Sep 29 06:40:33 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664033, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:33.516299 28418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:33.504439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:44443 (local address 127.15.157.129:39037)
0929 06:40:33.505209 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:33.505260 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:33.505881 (+ 621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:33.506496 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:33.506501 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:33.506759 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:33.507060 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:33.507067 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:33.508100 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:33.508102 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:33.509369 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:33.509372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:33.509948 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:33.509949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:33.510151 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:33.510738 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:33.510748 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:33.512430 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:33.514635 (+ 2205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:33.514641 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:33.514644 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:33.514950 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:33.515174 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:33.515175 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:33.515176 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:33.515316 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:33.515619 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:33.515625 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:33.515794 (+ 169us) client_negotiation.cc:769] Sending connection context
0929 06:40:33.515907 (+ 113us) client_negotiation.cc:240] Negotiation successful
0929 06:40:33.516060 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"thread_start_us":88,"threads_started":1}
I20260929 06:40:33.517073 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:33.504735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:39037 (local address 127.15.157.190:44443)
0929 06:40:33.506234 (+ 1499us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:33.506237 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:33.506246 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:40:33.506271 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:33.506272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:33.506285 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:33.506356 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:33.507171 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:33.507994 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:33.509477 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:33.509818 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:33.509881 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:33.512536 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:33.512537 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:33.512538 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:33.512545 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:33.514542 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:33.515041 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:33.515042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:33.515042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:33.515106 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:33.515392 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:33.515393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:33.515393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:33.515531 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:33.515592 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:33.516889 (+ 1297us) server_negotiation.cc:299] Negotiation successful
0929 06:40:33.516976 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1471,"thread_start_us":101,"threads_started":1}
I20260929 06:40:33.517624 28414 heartbeater.cc:347] Connected to a master server at 127.15.157.190:44443
I20260929 06:40:33.517760 28414 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:33.518038 28414 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
I20260929 06:40:33.518637 28203 ts_manager.cc:194] Registered new tserver with Master: 8030b74ebca44c9488b1b7d46a4c2e68 (127.15.157.129:37077)
I20260929 06:40:33.519531 28203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:39037
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:40:33.548785 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.157.148:36919/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:44443
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:33.659925 28421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:33.660267 28421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:33.660352 28421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:33.662081 28421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:33.662199 28421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:33.662395 28421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:40:33.664505 28421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.15.157.148:36919/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:44443
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:33.664979 28421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:33.665282 28421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:33.678995 28429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:33.679355 28431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:33.679611 28428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:33.683236 28421 server_base.cc:1034] running on GCE node
I20260929 06:40:33.683578 28421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:33.683854 28421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:33.691231 28421 hybrid_clock.cc:648] HybridClock initialized: now 1790664033691192 us; error 54 us; skew 500 ppm
Sep 29 06:40:33 dist-test-slave-ltw5 krb5kdc[27727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664033, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:33.694875 28421 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:40:33.695555 28421 webserver.cc:460] Webserver started at http://127.15.157.130:39709/ using document root <none> and password file <none>
I20260929 06:40:33.695873 28421 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:33.695997 28421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:33.696205 28421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:40:33 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664033, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:40:33.715078 28421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "348e7e7aa0504542bc6b699bede28911"
format_stamp: "Formatted at 2026-09-29 06:40:33 on dist-test-slave-ltw5"
server_key: "10f3d9b2b9a12b75e3031c4648272ef2"
server_key_iv: "41080fbe05081dbb999d92343643aa9e"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:33.715667 28421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "348e7e7aa0504542bc6b699bede28911"
format_stamp: "Formatted at 2026-09-29 06:40:33 on dist-test-slave-ltw5"
server_key: "10f3d9b2b9a12b75e3031c4648272ef2"
server_key_iv: "41080fbe05081dbb999d92343643aa9e"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:33.718477 28421 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
Sep 29 06:40:33 dist-test-slave-ltw5 krb5kdc[27727](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790664033, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:33.749560 28438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:33.751571 28421 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260929 06:40:33.751686 28421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "348e7e7aa0504542bc6b699bede28911"
format_stamp: "Formatted at 2026-09-29 06:40:33 on dist-test-slave-ltw5"
server_key: "10f3d9b2b9a12b75e3031c4648272ef2"
server_key_iv: "41080fbe05081dbb999d92343643aa9e"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:33.751784 28421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:33.779417 28421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:33.781623 28421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:33.781841 28421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:33.782177 28421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:33.782562 28421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:40:33.782616 28421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:33.782655 28421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:40:33.782681 28421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:33.790098 28421 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:40147
I20260929 06:40:33.790549 28421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:40:33.791285 28551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:40147 every 8 connection(s)
I20260929 06:40:33.794260 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 28421
I20260929 06:40:33.794358 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:40:33.794530 15990 external_mini_cluster.cc:1428] Setting key 3ad9f398938b015fc929366c620d04d8
Sep 29 06:40:33 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664033, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:33.803066 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:33.792158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:59051 (local address 127.15.157.190:44443)
0929 06:40:33.792205 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:33.792207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:33.792550 (+ 343us) server_negotiation.cc:407] Connection header received
0929 06:40:33.793254 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:33.793256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:33.793285 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:33.793318 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:33.794189 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:33.794972 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:33.796465 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:33.796793 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:33.796837 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:33.799597 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:33.799599 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:33.799599 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:33.799608 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:33.801368 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:33.801884 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:33.801885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:33.801885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:33.801951 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:33.802294 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:33.802295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:33.802296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:33.802440 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:33.802482 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:33.802869 (+ 387us) server_negotiation.cc:299] Negotiation successful
0929 06:40:33.802964 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:40:33.803637 28554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:33.791886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:44443 (local address 127.15.157.130:59051)
0929 06:40:33.792420 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:33.792465 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:33.793126 (+ 661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:33.793526 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:33.793531 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:33.793771 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:33.794067 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:33.794073 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:33.795083 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:33.795083 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:33.796359 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:33.796362 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:33.796941 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:33.796942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:33.797084 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:33.797730 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:33.797740 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:33.799475 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:33.801468 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:33.801476 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:33.801478 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:33.801784 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:33.802056 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:33.802057 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:33.802057 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:33.802201 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:33.802529 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:33.802535 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:33.802698 (+ 163us) client_negotiation.cc:769] Sending connection context
0929 06:40:33.803197 (+ 499us) client_negotiation.cc:240] Negotiation successful
0929 06:40:33.803398 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":78,"threads_started":1}
I20260929 06:40:33.804093 28552 heartbeater.cc:347] Connected to a master server at 127.15.157.190:44443
I20260929 06:40:33.804194 28552 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:33.804409 28552 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
I20260929 06:40:33.804774 28203 ts_manager.cc:194] Registered new tserver with Master: 348e7e7aa0504542bc6b699bede28911 (127.15.157.130:40147)
I20260929 06:40:33.805266 28203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:59051
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:40:33.836498 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.157.148:36919/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:44443
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:33.954887 28558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:33.955228 28558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:33.955309 28558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:33.956895 28558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:33.957001 28558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:33.957082 28558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:40:33.959126 28558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.15.157.148:36919/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:44443
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:33.959671 28558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:33.959990 28558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:33.966176 28564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:33.966562 28563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:33.966771 28566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:33.967828 28558 server_base.cc:1034] running on GCE node
I20260929 06:40:33.968125 28558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:33.968387 28558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:33.969549 28558 hybrid_clock.cc:648] HybridClock initialized: now 1790664033969529 us; error 32 us; skew 500 ppm
Sep 29 06:40:33 dist-test-slave-ltw5 krb5kdc[27727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664033, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:33.972785 28558 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:40:33.973258 28558 webserver.cc:460] Webserver started at http://127.15.157.131:38471/ using document root <none> and password file <none>
I20260929 06:40:33.973507 28558 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:33.973554 28558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:33.973670 28558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:40:33 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664033, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:40:33.989712 28558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "fc731b16696348e9bf669aafff3d2858"
format_stamp: "Formatted at 2026-09-29 06:40:33 on dist-test-slave-ltw5"
server_key: "8bd55e9585fe92f33e1ba392b39df3d7"
server_key_iv: "3eab23b20b4aa95024f6312719b9401b"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:33.990187 28558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "fc731b16696348e9bf669aafff3d2858"
format_stamp: "Formatted at 2026-09-29 06:40:33 on dist-test-slave-ltw5"
server_key: "8bd55e9585fe92f33e1ba392b39df3d7"
server_key_iv: "3eab23b20b4aa95024f6312719b9401b"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:33.996225 28558 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.002s
I20260929 06:40:34.014036 28573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:34.014245 28558 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260929 06:40:34.014346 28558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "fc731b16696348e9bf669aafff3d2858"
format_stamp: "Formatted at 2026-09-29 06:40:33 on dist-test-slave-ltw5"
server_key: "8bd55e9585fe92f33e1ba392b39df3d7"
server_key_iv: "3eab23b20b4aa95024f6312719b9401b"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:34.014469 28558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:34.044390 28558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:34.047097 28558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:34.047278 28558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:34.047559 28558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:34.047943 28558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:40:34.047996 28558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:34.048032 28558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:40:34.048058 28558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:34.054652 28558 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:36755
I20260929 06:40:34.055115 28558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:40:34.061494 28686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:36755 every 8 connection(s)
I20260929 06:40:34.063146 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 28558
I20260929 06:40:34.063249 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:40:34.063428 15990 external_mini_cluster.cc:1428] Setting key a1ff74bfafd4b8d9143189b899b7d9fd
Sep 29 06:40:34 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664033, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:34.075049 28419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:34.059834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:41069 (local address 127.15.157.190:44443)
0929 06:40:34.059908 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:34.059911 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:34.060283 (+ 372us) server_negotiation.cc:407] Connection header received
0929 06:40:34.060980 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:34.060981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:34.060994 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:34.061115 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:34.061986 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.062818 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.064588 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.064901 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.064974 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:34.067574 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:34.067576 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:34.067576 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:34.067584 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:34.069513 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:34.070100 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:34.070101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:34.070102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:34.070169 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:34.074140 (+ 3971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:34.074142 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:34.074142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:34.074330 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:34.074429 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:34.074843 (+ 414us) server_negotiation.cc:299] Negotiation successful
0929 06:40:34.074947 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 06:40:34.075573 28689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:34.059509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:44443 (local address 127.15.157.131:41069)
0929 06:40:34.060121 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:34.060174 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:34.060856 (+ 682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:34.061255 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:34.061260 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:34.061523 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:34.061874 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:34.061880 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.062916 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.062917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:34.064497 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:34.064499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.065018 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.065019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:34.065162 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:34.065820 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:34.065831 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:34.067456 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:34.069613 (+ 2157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:34.069620 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:34.069623 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:34.069954 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:34.070253 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:34.070254 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:34.070254 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:34.070411 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:34.074462 (+ 4051us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:34.074471 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:34.074665 (+ 194us) client_negotiation.cc:769] Sending connection context
0929 06:40:34.075144 (+ 479us) client_negotiation.cc:240] Negotiation successful
0929 06:40:34.075325 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":90,"threads_started":1}
I20260929 06:40:34.076092 28687 heartbeater.cc:347] Connected to a master server at 127.15.157.190:44443
I20260929 06:40:34.076191 28687 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:34.076380 28687 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
I20260929 06:40:34.076733 28203 ts_manager.cc:194] Registered new tserver with Master: fc731b16696348e9bf669aafff3d2858 (127.15.157.131:36755)
I20260929 06:40:34.077221 28203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:41069
I20260929 06:40:34.086257 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:40:34.086966 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 28284
I20260929 06:40:34.092957 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 28421
I20260929 06:40:34.098335 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 28558
I20260929 06:40:34.103508 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 28171
I20260929 06:40:34.109408 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:44443
--webserver_interface=127.15.157.190
--webserver_port=43593
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:44443
--ranger_config_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.157.148:36919/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.157.148:36919/kms with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:34.190250 28690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:34.190450 28690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:34.190472 28690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:34.191545 28690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:40:34.191581 28690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:34.191596 28690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:34.191607 28690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:40:34.191619 28690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:40:34.193081 28690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.157.148:36919/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:44443
--ranger_config_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:44443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=43593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:34.193255 28690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:34.193414 28690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:34.198287 28696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:34.198304 28695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:34.198335 28698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:34.198503 28690 server_base.cc:1034] running on GCE node
I20260929 06:40:34.198741 28690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:34.199033 28690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:34.200197 28690 hybrid_clock.cc:648] HybridClock initialized: now 1790664034200158 us; error 52 us; skew 500 ppm
Sep 29 06:40:34 dist-test-slave-ltw5 krb5kdc[27727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:34.202698 28690 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:40:34.203171 28690 webserver.cc:460] Webserver started at http://127.15.157.190:43593/ using document root <none> and password file <none>
I20260929 06:40:34.203402 28690 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:34.203474 28690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 06:40:34 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:40:34.268369 28690 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260929 06:40:34.269083 28706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:34.269284 28690 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:40:34.269402 28690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "d0d7ccd94f294db6929e148e7684cd08"
format_stamp: "Formatted at 2026-09-29 06:40:32 on dist-test-slave-ltw5"
server_key: "35b5e191d11cf39a3c4ad0c5fdeaa48c"
server_key_iv: "25b3841674cba105b99249ebd764ad7c"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:34.269765 28690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:34.303695 28690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:34.305922 28690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:34.306114 28690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:34.310138 28690 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:44443
I20260929 06:40:34.310174 28758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:44443 every 8 connection(s)
I20260929 06:40:34.310541 28690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:40:34.311686 28759 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:40:34.312354 28759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08: Bootstrap starting.
I20260929 06:40:34.315220 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 28690
I20260929 06:40:34.315506 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.157.148:36919/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:37077
--local_ip_for_outbound_sockets=127.15.157.129
--tserver_master_addrs=127.15.157.190:44443
--webserver_port=36807
--webserver_interface=127.15.157.129
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.157.148:36919/kms with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:40:34.320329 28759 log.cc:824] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:34.321976 28759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:40:34.322280 28759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08: Bootstrap complete.
I20260929 06:40:34.324591 28759 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0d7ccd94f294db6929e148e7684cd08" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44443 } }
I20260929 06:40:34.324846 28759 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d7ccd94f294db6929e148e7684cd08, State: Initialized, Role: FOLLOWER
I20260929 06:40:34.325057 28759 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0d7ccd94f294db6929e148e7684cd08" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44443 } }
I20260929 06:40:34.325153 28759 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:40:34.325206 28759 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:40:34.325253 28759 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 1 FOLLOWER]: Advancing to term 2
I20260929 06:40:34.326367 28759 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0d7ccd94f294db6929e148e7684cd08" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44443 } }
I20260929 06:40:34.326488 28759 leader_election.cc:302] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0d7ccd94f294db6929e148e7684cd08; no voters:
I20260929 06:40:34.326689 28759 leader_election.cc:288] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 06:40:34.326721 28763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 06:40:34.326825 28763 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [term 2 LEADER]: Becoming Leader. State: Replica: d0d7ccd94f294db6929e148e7684cd08, State: Running, Role: LEADER
I20260929 06:40:34.326925 28763 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0d7ccd94f294db6929e148e7684cd08" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44443 } }
I20260929 06:40:34.326969 28759 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:40:34.327167 28764 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d0d7ccd94f294db6929e148e7684cd08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0d7ccd94f294db6929e148e7684cd08" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44443 } } }
I20260929 06:40:34.327253 28764 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:34.327505 28765 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0d7ccd94f294db6929e148e7684cd08. Latest consensus state: current_term: 2 leader_uuid: "d0d7ccd94f294db6929e148e7684cd08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0d7ccd94f294db6929e148e7684cd08" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44443 } } }
I20260929 06:40:34.327600 28765 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08 [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:34.327620 28767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:40:34.328133 28767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:40:34.328271 28767 catalog_manager.cc:1259] Loaded cluster ID: 34da89638daf4d14afff4f85a6c4a5b1
I20260929 06:40:34.328316 28767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:40:34.328503 28759 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260929 06:40:34.332252 28767 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:40:34.332796 28767 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08: Loaded TSK: 0
I20260929 06:40:34.333122 28767 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 06:40:34.426713 28761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:34.426997 28761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:34.427038 28761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:34.428762 28761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:34.428887 28761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:34.428970 28761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:40:34.431097 28761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.157.148:36919/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:37077
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=36807
--tserver_master_addrs=127.15.157.190:44443
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:34.431552 28761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:34.431891 28761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:34.438313 28799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:34.438334 28797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:34.438618 28796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:34.439112 28761 server_base.cc:1034] running on GCE node
I20260929 06:40:34.439508 28761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:34.439812 28761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:34.440989 28761 hybrid_clock.cc:648] HybridClock initialized: now 1790664034440970 us; error 35 us; skew 500 ppm
Sep 29 06:40:34 dist-test-slave-ltw5 krb5kdc[27727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:34.443586 28761 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:40:34.444041 28761 webserver.cc:460] Webserver started at http://127.15.157.129:36807/ using document root <none> and password file <none>
I20260929 06:40:34.444316 28761 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:34.444484 28761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 06:40:34 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:40:34.481498 28761 fs_manager.cc:709] Time spent opening directory manager: real 0.014s user 0.001s sys 0.000s
I20260929 06:40:34.491941 28807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:34.492216 28761 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.000s sys 0.000s
I20260929 06:40:34.492319 28761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "8030b74ebca44c9488b1b7d46a4c2e68"
format_stamp: "Formatted at 2026-09-29 06:40:33 on dist-test-slave-ltw5"
server_key: "6677306cc2222d92992533e9e26205cd"
server_key_iv: "7c799fe5385e2477b83196b6eea16d3b"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:34.492842 28761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:34.537396 28761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:34.540174 28761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:34.540395 28761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:34.540681 28761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:34.541121 28761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:40:34.541211 28761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:34.541281 28761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:40:34.541324 28761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:34.548755 28761 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:37077
I20260929 06:40:34.549314 28761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:40:34.551355 28920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:37077 every 8 connection(s)
I20260929 06:40:34.552392 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 28761
I20260929 06:40:34.552692 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.157.148:36919/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:40147
--local_ip_for_outbound_sockets=127.15.157.130
--tserver_master_addrs=127.15.157.190:44443
--webserver_port=39709
--webserver_interface=127.15.157.130
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.157.148:36919/kms with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 06:40:34 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:34.567795 28923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:34.552871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:44443 (local address 127.15.157.129:41675)
0929 06:40:34.553423 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:34.553462 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:34.554152 (+ 690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:34.554916 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:34.554921 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:34.555196 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:34.555473 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:34.555479 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.557351 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.557352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:34.558990 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:34.558994 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.560152 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.560153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:34.560306 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:34.560975 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:34.560987 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:34.562840 (+ 1853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:34.565741 (+ 2901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:34.565749 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:34.565751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:34.566139 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:34.566454 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:34.566455 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:34.566455 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:34.566601 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:34.567130 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:34.567136 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:34.567289 (+ 153us) client_negotiation.cc:769] Sending connection context
0929 06:40:34.567386 (+ 97us) client_negotiation.cc:240] Negotiation successful
0929 06:40:34.567538 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":85,"threads_started":1}
I20260929 06:40:34.568327 28924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:34.552988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:41675 (local address 127.15.157.190:44443)
0929 06:40:34.553198 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:34.553209 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:34.553595 (+ 386us) server_negotiation.cc:407] Connection header received
0929 06:40:34.554473 (+ 878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:34.554483 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:34.554553 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:34.554676 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:34.555601 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.557214 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.559114 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.559889 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.559989 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:34.562997 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:34.563002 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:34.563003 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:34.563017 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:34.565618 (+ 2601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:34.566242 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:34.566247 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:34.566247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:34.566370 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:34.566683 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:34.566684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:34.566684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:34.567018 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:34.567101 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:34.568012 (+ 911us) server_negotiation.cc:299] Negotiation successful
0929 06:40:34.568140 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":78,"threads_started":1}
I20260929 06:40:34.569072 28921 heartbeater.cc:347] Connected to a master server at 127.15.157.190:44443
I20260929 06:40:34.569164 28921 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:34.569341 28921 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
W20260929 06:40:34.570235 28921 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:44443 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260929 06:40:34.570300 28921 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:34.570358 28921 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
I20260929 06:40:34.570731 28921 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:34.570799 28921 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
W20260929 06:40:34.571105 28921 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 06:40:34.656885 28925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:34.657092 28925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:34.657132 28925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:34.658313 28925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:34.658370 28925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:34.658416 28925 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:40:34.659992 28925 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.157.148:36919/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:40147
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=39709
--tserver_master_addrs=127.15.157.190:44443
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:34.660238 28925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:34.660497 28925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:34.665756 28930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:34.665776 28931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:34.667008 28933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:34.670217 28925 server_base.cc:1034] running on GCE node
I20260929 06:40:34.670410 28925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:34.670668 28925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:34.671864 28925 hybrid_clock.cc:648] HybridClock initialized: now 1790664034671845 us; error 33 us; skew 500 ppm
Sep 29 06:40:34 dist-test-slave-ltw5 krb5kdc[27727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:34.674628 28925 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:40:34.675041 28925 webserver.cc:460] Webserver started at http://127.15.157.130:39709/ using document root <none> and password file <none>
I20260929 06:40:34.675275 28925 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:34.675355 28925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 06:40:34 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:40:34.692682 28925 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:40:34.693961 28941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:34.694199 28925 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:40:34.694348 28925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "348e7e7aa0504542bc6b699bede28911"
format_stamp: "Formatted at 2026-09-29 06:40:33 on dist-test-slave-ltw5"
server_key: "10f3d9b2b9a12b75e3031c4648272ef2"
server_key_iv: "41080fbe05081dbb999d92343643aa9e"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:34.694725 28925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:34.725390 28925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:34.727965 28925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:34.728188 28925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:34.728530 28925 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:34.728941 28925 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:40:34.729033 28925 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:34.729115 28925 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:40:34.729175 28925 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:34.735801 28925 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:40147
I20260929 06:40:34.736339 28925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:40:34.738255 29054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:40147 every 8 connection(s)
I20260929 06:40:34.739645 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 28925
I20260929 06:40:34.739930 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.157.148:36919/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:36755
--local_ip_for_outbound_sockets=127.15.157.131
--tserver_master_addrs=127.15.157.190:44443
--webserver_port=38471
--webserver_interface=127.15.157.131
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:41689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.157.148:36919/kms with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 06:40:34 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:34.759737 29057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:34.739326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:44443 (local address 127.15.157.130:47059)
0929 06:40:34.739758 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:34.739801 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:34.740331 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:34.740726 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:34.740730 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:34.740972 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:34.741244 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:34.741251 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.742264 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.742265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:34.743539 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:34.743541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.744119 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.744120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:34.744264 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:34.754170 (+ 9906us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:34.754184 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:34.755897 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:34.757941 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:34.757949 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:34.757952 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:34.758283 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:34.758523 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:34.758524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:34.758525 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:34.758674 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:34.758990 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:34.758997 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:34.759182 (+ 185us) client_negotiation.cc:769] Sending connection context
0929 06:40:34.759299 (+ 117us) client_negotiation.cc:240] Negotiation successful
0929 06:40:34.759486 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":82,"threads_started":1}
I20260929 06:40:34.760468 28924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:34.739634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:47059 (local address 127.15.157.190:44443)
0929 06:40:34.739727 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:34.739730 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:34.739901 (+ 171us) server_negotiation.cc:407] Connection header received
0929 06:40:34.740488 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:34.740490 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:34.740505 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:34.740538 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:34.741357 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.742154 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.743643 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.743958 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.744005 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:34.756035 (+ 12030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:34.756037 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:34.756037 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:34.756047 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:34.757833 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:34.758390 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:34.758391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:34.758391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:34.758451 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:34.758752 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:34.758752 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:34.758753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:34.758897 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:34.758961 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:34.760269 (+ 1308us) server_negotiation.cc:299] Negotiation successful
0929 06:40:34.760377 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260929 06:40:34.760857 29055 heartbeater.cc:347] Connected to a master server at 127.15.157.190:44443
I20260929 06:40:34.760958 29055 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:34.761152 29055 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
W20260929 06:40:34.761904 29055 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:44443 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260929 06:40:34.761992 29055 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:34.762085 29055 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
I20260929 06:40:34.762465 29055 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:34.762553 29055 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
W20260929 06:40:34.762868 29055 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 06:40:34.844671 29058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:34.844957 29058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:34.844987 29058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:34.846385 29058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:34.846494 29058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:34.846547 29058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:40:34.848169 29058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:41689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.157.148:36919/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:36755
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=38471
--tserver_master_addrs=127.15.157.190:44443
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:34.848433 29058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:34.848650 29058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:34.853551 29067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:34.853672 29064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:34.853551 29065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:34.854272 29058 server_base.cc:1034] running on GCE node
I20260929 06:40:34.854482 29058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:34.854746 29058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:34.855906 29058 hybrid_clock.cc:648] HybridClock initialized: now 1790664034855890 us; error 21 us; skew 500 ppm
Sep 29 06:40:34 dist-test-slave-ltw5 krb5kdc[27727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:34.858507 29058 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:40:34.859038 29058 webserver.cc:460] Webserver started at http://127.15.157.131:38471/ using document root <none> and password file <none>
I20260929 06:40:34.859279 29058 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:34.859360 29058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 06:40:34 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:40:34.878974 29058 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:40:34.879932 29075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:34.880102 29058 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:40:34.880198 29058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "fc731b16696348e9bf669aafff3d2858"
format_stamp: "Formatted at 2026-09-29 06:40:33 on dist-test-slave-ltw5"
server_key: "8bd55e9585fe92f33e1ba392b39df3d7"
server_key_iv: "3eab23b20b4aa95024f6312719b9401b"
server_key_version: "kuduclusterkey@0"
I20260929 06:40:34.880580 29058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:34.893187 29058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:34.895625 29058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:34.895833 29058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:34.896126 29058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:34.896526 29058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:40:34.896611 29058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:34.896682 29058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:40:34.896736 29058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:34.903405 29058 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:36755
I20260929 06:40:34.903792 29058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:40:34.904455 29188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:36755 every 8 connection(s)
I20260929 06:40:34.909147 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 29058
Sep 29 06:40:34 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:34.917261 29193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:34.909716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49452 (local address 127.15.157.190:44443)
0929 06:40:34.909827 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:34.909829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:34.909836 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:40:34.909854 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:34.909855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:34.909865 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:34.909930 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:34.911093 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.911825 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.912940 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.913160 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.913238 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:34.914680 (+ 1442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:34.914681 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:34.914682 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:34.914688 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:34.916088 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:34.916449 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:34.916450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:34.916451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:34.916510 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:34.916708 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:34.916709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:34.916709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:34.916816 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:34.917013 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:34.917049 (+ 36us) server_negotiation.cc:299] Negotiation successful
0929 06:40:34.917130 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":62,"threads_started":1}
I20260929 06:40:34.918510 28924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:34.904606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:47951 (local address 127.15.157.190:44443)
0929 06:40:34.904653 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:34.904655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:34.904878 (+ 223us) server_negotiation.cc:407] Connection header received
0929 06:40:34.905458 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:34.905460 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:34.905472 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:34.905542 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:34.906176 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.906933 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.907902 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.908188 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.908266 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:34.910703 (+ 2437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:34.910704 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:34.910705 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:34.910712 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:34.912380 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:34.912831 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:34.912832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:34.912833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:34.912900 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:34.913209 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:34.913210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:34.913211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:34.913354 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:34.913429 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:34.918346 (+ 4917us) server_negotiation.cc:299] Negotiation successful
0929 06:40:34.918422 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:40:34.918746 29191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:34.904607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:44443 (local address 127.15.157.131:47951)
0929 06:40:34.904754 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:34.904800 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:34.905354 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:34.905643 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:34.905647 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:34.905823 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:34.906067 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:34.906072 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.907032 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.907033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:34.907807 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:34.907809 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:34.908285 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:34.908286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:34.908382 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:34.908939 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:34.908948 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:34.910592 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:34.912472 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:34.912478 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:34.912480 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:34.912747 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:34.912991 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:34.912993 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:34.912993 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:34.913131 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:34.918061 (+ 4930us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:34.918068 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:34.918206 (+ 138us) client_negotiation.cc:769] Sending connection context
0929 06:40:34.918325 (+ 119us) client_negotiation.cc:240] Negotiation successful
0929 06:40:34.918486 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":84,"threads_started":1}
I20260929 06:40:34.919231 29189 heartbeater.cc:347] Connected to a master server at 127.15.157.190:44443
I20260929 06:40:34.919350 29189 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:34.919540 29189 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
W20260929 06:40:34.920132 29189 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:44443 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260929 06:40:34.920213 29189 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:34.920284 29189 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
I20260929 06:40:34.920553 29189 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:34.920625 29189 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
W20260929 06:40:34.920899 29189 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 29 06:40:35 dist-test-slave-ltw5 krb5kdc[27727](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790664035, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:35.571292 28921 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:35.571470 28921 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
I20260929 06:40:35.571870 28723 ts_manager.cc:194] Registered new tserver with Master: 8030b74ebca44c9488b1b7d46a4c2e68 (127.15.157.129:37077)
I20260929 06:40:35.572943 28723 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:41675
I20260929 06:40:35.763046 29055 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:35.763195 29055 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
I20260929 06:40:35.763592 28723 ts_manager.cc:194] Registered new tserver with Master: 348e7e7aa0504542bc6b699bede28911 (127.15.157.130:40147)
I20260929 06:40:35.764125 28723 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:47059
Sep 29 06:40:35 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664035, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:40:35.921099 29189 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:35.921260 29189 heartbeater.cc:511] Master 127.15.157.190:44443 requested a full tablet report, sending...
I20260929 06:40:35.921604 28723 ts_manager.cc:194] Registered new tserver with Master: fc731b16696348e9bf669aafff3d2858 (127.15.157.131:36755)
I20260929 06:40:35.922137 28723 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:47951
I20260929 06:40:35.923911 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:40:35.938201 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:35.926318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49458 (local address 127.15.157.190:44443)
0929 06:40:35.930147 (+ 3829us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:35.930149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:35.930159 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:40:35.930184 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:35.930185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:35.930199 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:35.930294 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:35.931021 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:35.931738 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:35.932828 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:35.933143 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:35.933219 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:35.934859 (+ 1640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:35.934861 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:35.934861 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:35.934868 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:35.936795 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:35.937238 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:35.937240 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:35.937240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:35.937308 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:35.937546 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:35.937547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:35.937547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:35.937688 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:35.937803 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:35.937992 (+ 189us) server_negotiation.cc:299] Negotiation successful
0929 06:40:35.938099 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3808,"thread_start_us":58,"threads_started":1}
I20260929 06:40:35.940680 28723 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49458:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:40:35.942942 28723 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:40:35.951232 29217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:35.946086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43062 (local address 127.15.157.130:40147)
0929 06:40:35.946251 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:35.946257 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:35.946965 (+ 708us) server_negotiation.cc:407] Connection header received
0929 06:40:35.947012 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:35.947015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:35.947031 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:35.947118 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:40:35.947376 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:35.948473 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:35.949972 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:35.950741 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:35.950792 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:35.950838 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:35.951105 (+ 267us) server_negotiation.cc:299] Negotiation successful
0929 06:40:35.951146 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":71,"threads_started":1}
I20260929 06:40:35.951388 29219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:35.946332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36974 (local address 127.15.157.129:37077)
0929 06:40:35.946462 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:35.946467 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:35.947074 (+ 607us) server_negotiation.cc:407] Connection header received
0929 06:40:35.947168 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:35.947171 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:35.947186 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:35.947235 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:40:35.947452 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:35.948482 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:35.949968 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:35.950705 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:35.950753 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:35.950832 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:35.951269 (+ 437us) server_negotiation.cc:299] Negotiation successful
0929 06:40:35.951313 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":67,"threads_started":1}
I20260929 06:40:35.951722 29220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:35.946144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:37077 (local address 127.0.0.1:36974)
0929 06:40:35.947026 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:35.947033 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:35.947096 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:35.947328 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:35.947329 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:35.947331 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:40:35.947383 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:35.947385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:35.948808 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:35.948809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:35.949871 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:35.949873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:35.951113 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:35.951114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:35.951181 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:35.951184 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:40:35.951555 (+ 371us) client_negotiation.cc:240] Negotiation successful
0929 06:40:35.951617 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":869,"thread_start_us":53,"threads_started":1}
I20260929 06:40:35.951785 29218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:35.945923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:40147 (local address 127.0.0.1:43062)
0929 06:40:35.946829 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:35.946867 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:35.946935 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:35.947218 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:35.947221 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:35.947223 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:40:35.947286 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:35.947288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:35.948574 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:35.948575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:35.949850 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:35.949853 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:35.950898 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:35.950899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:35.950990 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:35.951001 (+ 11us) client_negotiation.cc:769] Sending connection context
0929 06:40:35.951600 (+ 599us) client_negotiation.cc:240] Negotiation successful
0929 06:40:35.951646 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":877,"thread_start_us":73,"threads_started":1}
I20260929 06:40:35.952666 28855 tablet_service.cc:1467] Processing CreateTablet for tablet 90189c8b330d46e8a0bc01e726979839 (DEFAULT_TABLE table=test-table [id=94a187471da740fe92daeb0db296f263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:40:35.953032 28855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90189c8b330d46e8a0bc01e726979839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:35.954497 28971 tablet_service.cc:1467] Processing CreateTablet for tablet 90189c8b330d46e8a0bc01e726979839 (DEFAULT_TABLE table=test-table [id=94a187471da740fe92daeb0db296f263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:40:35.954828 28971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90189c8b330d46e8a0bc01e726979839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:35.956023 29220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:35.946531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:36755 (local address 127.0.0.1:60072)
0929 06:40:35.952230 (+ 5699us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:35.952240 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:35.952282 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:35.952474 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:35.952475 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:35.952477 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:40:35.952508 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:35.952509 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:35.953711 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:35.953712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:35.954815 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:35.954817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:35.955791 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:35.955791 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:35.955848 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:35.955851 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:40:35.955897 (+ 46us) client_negotiation.cc:240] Negotiation successful
0929 06:40:35.955936 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5687,"thread_start_us":60,"threads_started":1}
I20260929 06:40:35.956312 29221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:35.946622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60072 (local address 127.15.157.131:36755)
0929 06:40:35.946753 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:35.946757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:35.952345 (+ 5588us) server_negotiation.cc:407] Connection header received
0929 06:40:35.952386 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:35.952389 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:35.952405 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:35.952476 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:40:35.952557 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:35.953541 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:35.954907 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:35.955627 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:35.955697 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:35.955747 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:35.956181 (+ 434us) server_negotiation.cc:299] Negotiation successful
0929 06:40:35.956231 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":55,"threads_started":1}
I20260929 06:40:35.956975 29123 tablet_service.cc:1467] Processing CreateTablet for tablet 90189c8b330d46e8a0bc01e726979839 (DEFAULT_TABLE table=test-table [id=94a187471da740fe92daeb0db296f263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:40:35.957346 29123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90189c8b330d46e8a0bc01e726979839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:35.960814 29224 tablet_bootstrap.cc:492] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858: Bootstrap starting.
I20260929 06:40:35.961180 29222 tablet_bootstrap.cc:492] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68: Bootstrap starting.
I20260929 06:40:35.961611 29224 tablet_bootstrap.cc:654] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:35.961812 29222 tablet_bootstrap.cc:654] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:35.961968 29224 log.cc:824] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:35.962144 29222 log.cc:824] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:35.963020 29222 tablet_bootstrap.cc:492] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68: No bootstrap required, opened a new log
I20260929 06:40:35.963083 29222 ts_tablet_manager.cc:1397] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 06:40:35.965581 29222 raft_consensus.cc:348] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348e7e7aa0504542bc6b699bede28911" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40147 } } peers { permanent_uuid: "fc731b16696348e9bf669aafff3d2858" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36755 } } peers { permanent_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37077 } }
I20260929 06:40:35.965747 29222 raft_consensus.cc:374] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:35.965786 29222 raft_consensus.cc:729] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8030b74ebca44c9488b1b7d46a4c2e68, State: Initialized, Role: FOLLOWER
I20260929 06:40:35.965929 29222 consensus_queue.cc:260] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348e7e7aa0504542bc6b699bede28911" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40147 } } peers { permanent_uuid: "fc731b16696348e9bf669aafff3d2858" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36755 } } peers { permanent_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37077 } }
I20260929 06:40:35.966181 29222 ts_tablet_manager.cc:1428] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 06:40:35.966293 28921 heartbeater.cc:503] Master 127.15.157.190:44443 was elected leader, sending a full tablet report...
I20260929 06:40:35.970183 29223 tablet_bootstrap.cc:492] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911: Bootstrap starting.
I20260929 06:40:35.970813 29223 tablet_bootstrap.cc:654] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:35.971066 29224 tablet_bootstrap.cc:492] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858: No bootstrap required, opened a new log
I20260929 06:40:35.971153 29224 ts_tablet_manager.cc:1397] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20260929 06:40:35.971145 29223 log.cc:824] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:35.973513 29224 raft_consensus.cc:348] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348e7e7aa0504542bc6b699bede28911" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40147 } } peers { permanent_uuid: "fc731b16696348e9bf669aafff3d2858" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36755 } } peers { permanent_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37077 } }
I20260929 06:40:35.973701 29224 raft_consensus.cc:374] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:35.973739 29224 raft_consensus.cc:729] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc731b16696348e9bf669aafff3d2858, State: Initialized, Role: FOLLOWER
I20260929 06:40:35.973968 29224 consensus_queue.cc:260] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348e7e7aa0504542bc6b699bede28911" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40147 } } peers { permanent_uuid: "fc731b16696348e9bf669aafff3d2858" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36755 } } peers { permanent_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37077 } }
I20260929 06:40:35.974416 29223 tablet_bootstrap.cc:492] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911: No bootstrap required, opened a new log
I20260929 06:40:35.974411 29224 ts_tablet_manager.cc:1428] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:40:35.974532 29189 heartbeater.cc:503] Master 127.15.157.190:44443 was elected leader, sending a full tablet report...
I20260929 06:40:35.974536 29223 ts_tablet_manager.cc:1397] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260929 06:40:35.976624 29223 raft_consensus.cc:348] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348e7e7aa0504542bc6b699bede28911" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40147 } } peers { permanent_uuid: "fc731b16696348e9bf669aafff3d2858" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36755 } } peers { permanent_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37077 } }
I20260929 06:40:35.976825 29223 raft_consensus.cc:374] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:35.976876 29223 raft_consensus.cc:729] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348e7e7aa0504542bc6b699bede28911, State: Initialized, Role: FOLLOWER
I20260929 06:40:35.977000 29223 consensus_queue.cc:260] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348e7e7aa0504542bc6b699bede28911" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40147 } } peers { permanent_uuid: "fc731b16696348e9bf669aafff3d2858" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36755 } } peers { permanent_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37077 } }
I20260929 06:40:35.977263 29223 ts_tablet_manager.cc:1428] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:40:35.977298 29055 heartbeater.cc:503] Master 127.15.157.190:44443 was elected leader, sending a full tablet report...
W20260929 06:40:35.989387 29056 tablet.cc:2369] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:40:36.011150 29227 raft_consensus.cc:482] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:40:36.011356 29227 raft_consensus.cc:504] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348e7e7aa0504542bc6b699bede28911" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40147 } } peers { permanent_uuid: "fc731b16696348e9bf669aafff3d2858" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36755 } } peers { permanent_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37077 } }
I20260929 06:40:36.011790 29227 leader_election.cc:288] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348e7e7aa0504542bc6b699bede28911 (127.15.157.130:40147), fc731b16696348e9bf669aafff3d2858 (127.15.157.131:36755)
I20260929 06:40:36.016322 29217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:36.012142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:60207 (local address 127.15.157.130:40147)
0929 06:40:36.012192 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:36.012195 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:36.012690 (+ 495us) server_negotiation.cc:407] Connection header received
0929 06:40:36.012799 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:36.012801 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:36.012811 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:36.012840 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:40:36.013067 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:36.013840 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:36.015327 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:36.015901 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:36.015953 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:36.015962 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:36.016192 (+ 230us) server_negotiation.cc:299] Negotiation successful
0929 06:40:36.016249 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 06:40:36.016763 29232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:36.012094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:40147 (local address 127.15.157.129:60207)
0929 06:40:36.012619 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:36.012630 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:36.012720 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:36.012908 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:36.012909 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:36.012911 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:40:36.012987 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:36.012990 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:36.013947 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:36.013948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:36.015218 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:36.015221 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:36.016039 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:36.016040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:36.016108 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:36.016112 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:40:36.016622 (+ 510us) client_negotiation.cc:240] Negotiation successful
0929 06:40:36.016666 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":88,"threads_started":1}
I20260929 06:40:36.017318 28990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90189c8b330d46e8a0bc01e726979839" candidate_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348e7e7aa0504542bc6b699bede28911" is_pre_election: true
I20260929 06:40:36.017491 28990 raft_consensus.cc:2454] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8030b74ebca44c9488b1b7d46a4c2e68 in term 0.
I20260929 06:40:36.017724 28809 leader_election.cc:302] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348e7e7aa0504542bc6b699bede28911, 8030b74ebca44c9488b1b7d46a4c2e68; no voters:
I20260929 06:40:36.017848 29227 raft_consensus.cc:2781] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:40:36.017882 29227 raft_consensus.cc:482] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:40:36.017902 29227 raft_consensus.cc:3037] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:40:36.018893 29227 raft_consensus.cc:504] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348e7e7aa0504542bc6b699bede28911" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40147 } } peers { permanent_uuid: "fc731b16696348e9bf669aafff3d2858" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36755 } } peers { permanent_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37077 } }
I20260929 06:40:36.019034 29227 leader_election.cc:288] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [CANDIDATE]: Term 1 election: Requested vote from peers 348e7e7aa0504542bc6b699bede28911 (127.15.157.130:40147), fc731b16696348e9bf669aafff3d2858 (127.15.157.131:36755)
I20260929 06:40:36.019284 28990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90189c8b330d46e8a0bc01e726979839" candidate_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348e7e7aa0504542bc6b699bede28911"
I20260929 06:40:36.019364 28990 raft_consensus.cc:3037] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:40:36.020290 28990 raft_consensus.cc:2454] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8030b74ebca44c9488b1b7d46a4c2e68 in term 1.
I20260929 06:40:36.020435 29231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:36.012320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:36755 (local address 127.15.157.129:35927)
0929 06:40:36.014567 (+ 2247us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:36.014579 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:36.014666 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:36.017287 (+ 2621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:36.017288 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:36.017290 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:40:36.017346 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:36.017348 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:36.018393 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:36.018394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:36.019455 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:36.019458 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:36.020202 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:36.020203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:36.020275 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:36.020279 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:40:36.020324 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 06:40:36.020363 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2229,"thread_start_us":80,"threads_started":1}
I20260929 06:40:36.020524 28809 leader_election.cc:302] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348e7e7aa0504542bc6b699bede28911, 8030b74ebca44c9488b1b7d46a4c2e68; no voters:
I20260929 06:40:36.020609 29227 raft_consensus.cc:2781] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:40:36.020762 29227 raft_consensus.cc:686] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [term 1 LEADER]: Becoming Leader. State: Replica: 8030b74ebca44c9488b1b7d46a4c2e68, State: Running, Role: LEADER
I20260929 06:40:36.020861 29221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:36.012517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:35927 (local address 127.15.157.131:36755)
0929 06:40:36.012561 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:36.012563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:36.014640 (+ 2077us) server_negotiation.cc:407] Connection header received
0929 06:40:36.014752 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:36.014753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:36.014764 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:36.014791 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:40:36.017436 (+ 2645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:36.018136 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:36.019529 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:36.020082 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:36.020159 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:36.020168 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:36.020744 (+ 576us) server_negotiation.cc:299] Negotiation successful
0929 06:40:36.020803 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:40:36.020861 29227 consensus_queue.cc:237] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348e7e7aa0504542bc6b699bede28911" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40147 } } peers { permanent_uuid: "fc731b16696348e9bf669aafff3d2858" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36755 } } peers { permanent_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37077 } }
I20260929 06:40:36.021150 29143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90189c8b330d46e8a0bc01e726979839" candidate_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc731b16696348e9bf669aafff3d2858" is_pre_election: true
I20260929 06:40:36.021274 29143 raft_consensus.cc:2454] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8030b74ebca44c9488b1b7d46a4c2e68 in term 0.
I20260929 06:40:36.021371 29142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90189c8b330d46e8a0bc01e726979839" candidate_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc731b16696348e9bf669aafff3d2858"
I20260929 06:40:36.021412 29142 raft_consensus.cc:3037] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:40:36.022197 29142 raft_consensus.cc:2454] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8030b74ebca44c9488b1b7d46a4c2e68 in term 1.
I20260929 06:40:36.022513 28723 catalog_manager.cc:5495] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8030b74ebca44c9488b1b7d46a4c2e68 (127.15.157.129). New cstate: current_term: 1 leader_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348e7e7aa0504542bc6b699bede28911" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc731b16696348e9bf669aafff3d2858" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8030b74ebca44c9488b1b7d46a4c2e68" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37077 } health_report { overall_health: HEALTHY } } }
Sep 29 06:40:36 dist-test-slave-ltw5 krb5kdc[27727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664035, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for HTTP/127.15.157.148@KRBTEST.COM
I20260929 06:40:36.053548 29219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:36.050122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36986 (local address 127.15.157.129:37077)
0929 06:40:36.050168 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:36.050170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:36.050178 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:40:36.050231 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:36.050232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:36.050254 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:36.050326 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:40:36.050503 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:36.051278 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:36.052434 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:36.052739 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:36.052800 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:36.052990 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:40:36.053130 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:40:36.053200 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:36.053444 (+ 244us) server_negotiation.cc:299] Negotiation successful
0929 06:40:36.053466 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260929 06:40:36.053865 28922 tablet.cc:2369] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:40:36.055955 29142 raft_consensus.cc:1261] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858 [term 1 FOLLOWER]: Refusing update from remote peer 8030b74ebca44c9488b1b7d46a4c2e68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:40:36.056355 29234 consensus_queue.cc:1035] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc731b16696348e9bf669aafff3d2858" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 36755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:40:36.056847 28990 raft_consensus.cc:1261] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911 [term 1 FOLLOWER]: Refusing update from remote peer 8030b74ebca44c9488b1b7d46a4c2e68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:40:36.057500 29234 consensus_queue.cc:1035] T 90189c8b330d46e8a0bc01e726979839 P 8030b74ebca44c9488b1b7d46a4c2e68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348e7e7aa0504542bc6b699bede28911" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:40:36.061126 29237 mvcc.cc:205] Tried to move back new op lower bound from 7334559891682095104 to 7334559891542073344. Current Snapshot: MvccSnapshot[applied={T|T < 7334559891682095104}]
I20260929 06:40:36.061893 29240 mvcc.cc:205] Tried to move back new op lower bound from 7334559891682095104 to 7334559891542073344. Current Snapshot: MvccSnapshot[applied={T|T < 7334559891682095104}]
I20260929 06:40:36.066220 29238 mvcc.cc:205] Tried to move back new op lower bound from 7334559891682095104 to 7334559891542073344. Current Snapshot: MvccSnapshot[applied={T|T < 7334559891682095104}]
I20260929 06:40:36.067507 28723 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49458:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:40:36.067626 28723 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49458:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:40:36.068315 28723 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d0d7ccd94f294db6929e148e7684cd08: Sending DeleteTablet for 3 replicas of tablet 90189c8b330d46e8a0bc01e726979839
I20260929 06:40:36.068781 28971 tablet_service.cc:1514] Processing DeleteTablet for tablet 90189c8b330d46e8a0bc01e726979839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:40:36 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:43062
I20260929 06:40:36.069008 28855 tablet_service.cc:1514] Processing DeleteTablet for tablet 90189c8b330d46e8a0bc01e726979839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:40:36 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:36974
I20260929 06:40:36.069454 29123 tablet_service.cc:1514] Processing DeleteTablet for tablet 90189c8b330d46e8a0bc01e726979839 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:40:36 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:60072
I20260929 06:40:36.070147 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 28761
I20260929 06:40:36.074674 29248 tablet_replica.cc:330] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858: stopping tablet replica
I20260929 06:40:36.074843 29248 raft_consensus.cc:2229] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:40:36.075039 29248 raft_consensus.cc:2258] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:40:36.075274 29246 tablet_replica.cc:330] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911: stopping tablet replica
I20260929 06:40:36.076539 29246 raft_consensus.cc:2229] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:40:36.076669 29246 raft_consensus.cc:2258] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:40:36.076829 29248 ts_tablet_manager.cc:1905] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:40:36.077867 29246 ts_tablet_manager.cc:1905] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:40:36.079779 29246 ts_tablet_manager.cc:1918] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:40:36.079850 29246 log.cc:1196] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/90189c8b330d46e8a0bc01e726979839
I20260929 06:40:36.080112 29246 ts_tablet_manager.cc:1939] T 90189c8b330d46e8a0bc01e726979839 P 348e7e7aa0504542bc6b699bede28911: Deleting consensus metadata
I20260929 06:40:36.080385 29248 ts_tablet_manager.cc:1918] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:40:36.080685 28708 catalog_manager.cc:4841] TS 348e7e7aa0504542bc6b699bede28911 (127.15.157.130:40147): tablet 90189c8b330d46e8a0bc01e726979839 (table test-table [id=94a187471da740fe92daeb0db296f263]) successfully deleted
I20260929 06:40:36.082671 29248 log.cc:1196] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/90189c8b330d46e8a0bc01e726979839
W20260929 06:40:36.082957 28708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:37077 (error 108)
I20260929 06:40:36.083214 29248 ts_tablet_manager.cc:1939] T 90189c8b330d46e8a0bc01e726979839 P fc731b16696348e9bf669aafff3d2858: Deleting consensus metadata
I20260929 06:40:36.083681 28710 catalog_manager.cc:4841] TS fc731b16696348e9bf669aafff3d2858 (127.15.157.131:36755): tablet 90189c8b330d46e8a0bc01e726979839 (table test-table [id=94a187471da740fe92daeb0db296f263]) successfully deleted
I20260929 06:40:36.083807 29220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:36.083676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:37077 (local address 127.0.0.1:37000)
0929 06:40:36.083726 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:36.083770 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:37077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260929 06:40:36.083962 28708 catalog_manager.cc:4584] TS 8030b74ebca44c9488b1b7d46a4c2e68 (127.15.157.129:37077): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 90189c8b330d46e8a0bc01e726979839: Network error: Client connection negotiation failed: client connection to 127.15.157.129:37077: connect: Connection refused (error 111)
I20260929 06:40:36.084183 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 28925
I20260929 06:40:36.090094 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 29058
I20260929 06:40:36.096709 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 28690
I20260929 06:40:36.107980 15990 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260929 06:40:36.452512 15990 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260929 06:40:36.452608 15990 mini_ranger.cc:66] Stopping Ranger...
I20260929 06:40:36.797050 15990 mini_ranger.cc:68] Stopped Ranger
2026-09-29 06:40:36.797 UTC [27757] LOG: received smart shutdown request
2026-09-29 06:40:36.801 UTC [27757] LOG: background worker "logical replication launcher" (PID 27766) exited with exit code 1
2026-09-29 06:40:36.801 UTC [27761] LOG: shutting down
2026-09-29 06:40:36.971 UTC [27757] LOG: database system is shut down
2026-09-29T06:40:36Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (48136 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:40:37 dist-test-slave-ltw5 krb5kdc[29259](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:40:37 dist-test-slave-ltw5 krb5kdc[29259](info): set up 2 sockets
Sep 29 06:40:37 dist-test-slave-ltw5 krb5kdc[29259](info): commencing operation
krb5kdc: starting...
W20260929 06:40:38.110088 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.010s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:40:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:40:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:40:38.230893 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:34403
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:34403,127.15.157.189:37151,127.15.157.188:46173
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:38.311298 29272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:38.311499 29272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:38.311522 29272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:38.312757 29272 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:40:38.312811 29272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:38.312860 29272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:38.312891 29272 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:40:38.312906 29272 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:40:38.314419 29272 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:34403,127.15.157.189:37151,127.15.157.188:46173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:34403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:38.314678 29272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:38.314922 29272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:38.319749 29278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:38.319839 29280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:38.319839 29277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:38.320247 29272 server_base.cc:1034] running on GCE node
I20260929 06:40:38.320487 29272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:38.321002 29272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:38.322158 29272 hybrid_clock.cc:648] HybridClock initialized: now 1790664038322140 us; error 38 us; skew 500 ppm
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:38.328176 29272 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:40:38.328677 29272 webserver.cc:460] Webserver started at http://127.15.157.190:46807/ using document root <none> and password file <none>
I20260929 06:40:38.328953 29272 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:38.328998 29272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:38.329170 29272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:40:38.330327 29272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "5d492054457a45649460980d7029659d"
format_stamp: "Formatted at 2026-09-29 06:40:38 on dist-test-slave-ltw5"
server_key: "998150730cbc0eb0476a806cb3f7db0f"
server_key_iv: "4c501c9677822bb0a6d042c1bb7e362d"
server_key_version: "encryptionkey@0"
I20260929 06:40:38.330688 29272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "5d492054457a45649460980d7029659d"
format_stamp: "Formatted at 2026-09-29 06:40:38 on dist-test-slave-ltw5"
server_key: "998150730cbc0eb0476a806cb3f7db0f"
server_key_iv: "4c501c9677822bb0a6d042c1bb7e362d"
server_key_version: "encryptionkey@0"
I20260929 06:40:38.332051 29272 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:40:38.332886 29287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:38.333112 29272 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:40:38.333192 29272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "5d492054457a45649460980d7029659d"
format_stamp: "Formatted at 2026-09-29 06:40:38 on dist-test-slave-ltw5"
server_key: "998150730cbc0eb0476a806cb3f7db0f"
server_key_iv: "4c501c9677822bb0a6d042c1bb7e362d"
server_key_version: "encryptionkey@0"
I20260929 06:40:38.333297 29272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:38.356315 29272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:38.358258 29272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:38.358418 29272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:38.362624 29272 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:34403
I20260929 06:40:38.362703 29339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:34403 every 8 connection(s)
I20260929 06:40:38.363067 29272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:40:38.363937 29340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:38.365576 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 29272
I20260929 06:40:38.365681 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:40:38.365571 29340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:40:38.365859 15990 external_mini_cluster.cc:1428] Setting key b3ab7a592696249a6d40aa4699ddf125
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.157.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.189@KRBTEST.COM" created.
I20260929 06:40:38.377468 29343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.366456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48606 (local address 127.15.157.190:34403)
0929 06:40:38.366637 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.366646 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.366764 (+ 118us) server_negotiation.cc:407] Connection header received
0929 06:40:38.367596 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.367599 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.367623 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.367741 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.368281 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.369227 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.370695 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.371019 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.371103 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.373881 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.373888 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.373889 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.373895 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.375685 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.376173 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.376176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.376177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.376254 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.376522 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.376522 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.376523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.376832 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.376923 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.377161 (+ 238us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.377264 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":81,"threads_started":1}
I20260929 06:40:38.377581 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.366424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:34403 (local address 127.0.0.1:48606)
0929 06:40:38.366618 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.366664 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:38.367385 (+ 721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:38.367740 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:38.367742 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:38.367997 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:38.368169 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.368174 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.369335 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.369337 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.370604 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.370608 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.371113 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.371115 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.371209 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.371772 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:38.371782 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:38.373658 (+ 1876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:38.375778 (+ 2120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.375785 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.375787 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.376097 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.376314 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.376315 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.376315 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.376446 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.376926 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:38.376933 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:38.377018 (+ 85us) client_negotiation.cc:769] Sending connection context
0929 06:40:38.377127 (+ 109us) client_negotiation.cc:240] Negotiation successful
0929 06:40:38.377344 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":47,"thread_start_us":95,"threads_started":1}
I20260929 06:40:38.378667 29340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:40:38.379056 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.378915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:37151 (local address 127.0.0.1:42682)
0929 06:40:38.378969 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.379023 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:37151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 06:40:38.379220 29290 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.157.189:37151: connect: Connection refused (error 111)
I20260929 06:40:38.379674 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.379569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:37151 (local address 127.0.0.1:42694)
0929 06:40:38.379623 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.379651 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:37151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260929 06:40:38.379786 29340 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.189:37151: Network error: Client connection negotiation failed: client connection to 127.15.157.189:37151: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.189.keytab.
Entry for principal kudu/127.15.157.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.189.keytab.
I20260929 06:40:38.392972 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.189:37151
--webserver_interface=127.15.157.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.189.keytab
--principal=kudu/127.15.157.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:34403,127.15.157.189:37151,127.15.157.188:46173
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:40:38.429067 29340 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } attempt: 1
I20260929 06:40:38.429643 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.429493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:37151 (local address 127.0.0.1:42708)
0929 06:40:38.429564 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.429609 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:37151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260929 06:40:38.430114 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.429985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:37151 (local address 127.0.0.1:42714)
0929 06:40:38.430061 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.430096 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:37151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260929 06:40:38.430245 29340 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.189:37151: Network error: Client connection negotiation failed: client connection to 127.15.157.189:37151: connect: Connection refused (error 111)
W20260929 06:40:38.474255 29347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:38.474448 29347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:38.474470 29347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:38.475533 29347 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:40:38.475566 29347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:38.475580 29347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:38.475592 29347 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:40:38.475605 29347 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:40:38.477881 29347 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:34403,127.15.157.189:37151,127.15.157.188:46173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.189.keytab
--principal=kudu/127.15.157.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.189:37151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.157.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:38.478188 29347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:38.478425 29347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:38.484367 29355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:38.484393 29352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:38.484371 29353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:38.485579 29347 server_base.cc:1034] running on GCE node
I20260929 06:40:38.485843 29347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:38.486202 29347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:38.487372 29347 hybrid_clock.cc:648] HybridClock initialized: now 1790664038487350 us; error 35 us; skew 500 ppm
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:38.489897 29347 init.cc:377] Logged in from keytab as kudu/127.15.157.189@KRBTEST.COM (short username kudu)
I20260929 06:40:38.490379 29347 webserver.cc:460] Webserver started at http://127.15.157.189:37405/ using document root <none> and password file <none>
I20260929 06:40:38.490602 29347 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:38.490649 29347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:38.490798 29347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:40:38.491863 29347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/data/instance:
uuid: "71b2958670ea4fa88a54b351ad4454b2"
format_stamp: "Formatted at 2026-09-29 06:40:38 on dist-test-slave-ltw5"
server_key: "42766f478133125f1a4f98c5a1dcb471"
server_key_iv: "b6d3fab8e692fe5c831e1e20ce5b6a7b"
server_key_version: "encryptionkey@0"
I20260929 06:40:38.492213 29347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/wal/instance:
uuid: "71b2958670ea4fa88a54b351ad4454b2"
format_stamp: "Formatted at 2026-09-29 06:40:38 on dist-test-slave-ltw5"
server_key: "42766f478133125f1a4f98c5a1dcb471"
server_key_iv: "b6d3fab8e692fe5c831e1e20ce5b6a7b"
server_key_version: "encryptionkey@0"
I20260929 06:40:38.493513 29347 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:40:38.494282 29362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:38.494462 29347 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:40:38.494565 29347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/wal
uuid: "71b2958670ea4fa88a54b351ad4454b2"
format_stamp: "Formatted at 2026-09-29 06:40:38 on dist-test-slave-ltw5"
server_key: "42766f478133125f1a4f98c5a1dcb471"
server_key_iv: "b6d3fab8e692fe5c831e1e20ce5b6a7b"
server_key_version: "encryptionkey@0"
I20260929 06:40:38.494638 29347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:38.498409 29340 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } attempt: 2
I20260929 06:40:38.498778 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.498651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:37151 (local address 127.0.0.1:42730)
0929 06:40:38.498709 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.498747 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:37151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 06:40:38.499089 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.499027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:37151 (local address 127.0.0.1:42740)
0929 06:40:38.499050 (+ 23us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.499072 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:37151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260929 06:40:38.499185 29340 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.189:37151: Network error: Client connection negotiation failed: client connection to 127.15.157.189:37151: connect: Connection refused (error 111)
I20260929 06:40:38.521322 29347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:38.523236 29347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:38.523394 29347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:38.527400 29347 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.189:37151
I20260929 06:40:38.527454 29414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.189:37151 every 8 connection(s)
I20260929 06:40:38.527839 29347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/data/info.pb
I20260929 06:40:38.528154 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 29347
I20260929 06:40:38.528267 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-1/wal/instance
I20260929 06:40:38.528460 15990 external_mini_cluster.cc:1428] Setting key 685c456dab1938753065b2ef8bf69e5b
I20260929 06:40:38.528924 29415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:38.530699 29415 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.15.157.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.188@KRBTEST.COM" created.
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.189@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:38.543864 29343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.531542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48610 (local address 127.15.157.190:34403)
0929 06:40:38.531595 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.531598 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.531777 (+ 179us) server_negotiation.cc:407] Connection header received
0929 06:40:38.532538 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.532539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.532549 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.532605 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.533558 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.534126 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.535727 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.535933 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.535990 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.540599 (+ 4609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.540600 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.540601 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.540609 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.542372 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.542772 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.542773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.542773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.542839 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.543093 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.543094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.543094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.543250 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.543325 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.543646 (+ 321us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.543746 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 06:40:38.543883 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.531416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:34403 (local address 127.0.0.1:48610)
0929 06:40:38.531623 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.531673 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:38.532412 (+ 739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:38.532685 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:38.532689 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:38.533122 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:38.533433 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.533440 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.534255 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.534257 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.535613 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.535616 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.536050 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.536052 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.536230 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.536878 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:38.536893 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:38.540490 (+ 3597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:38.542453 (+ 1963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.542460 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.542462 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.542691 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.542914 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.542915 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.542915 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.543024 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.543319 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:38.543323 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:38.543504 (+ 181us) client_negotiation.cc:769] Sending connection context
0929 06:40:38.543593 (+ 89us) client_negotiation.cc:240] Negotiation successful
0929 06:40:38.543716 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":97,"threads_started":1}
I20260929 06:40:38.544517 29415 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.189@KRBTEST.COM for kudu/127.15.157.189@KRBTEST.COM
I20260929 06:40:38.553624 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.544802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:37151 (local address 127.0.0.1:42756)
0929 06:40:38.544858 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.544871 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:38.544919 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:38.545142 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:38.545143 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:38.545305 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:38.545369 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.545371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.546258 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.546259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.547118 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.547121 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.547576 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.547577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.547651 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.548025 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:38.548031 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:38.550811 (+ 2780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:38.552567 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.552568 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.552568 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.552732 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.552955 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.552956 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.552957 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.553011 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.553308 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:38.553309 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:38.553347 (+ 38us) client_negotiation.cc:769] Sending connection context
0929 06:40:38.553409 (+ 62us) client_negotiation.cc:240] Negotiation successful
0929 06:40:38.553504 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260929 06:40:38.553687 29420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.544839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42756 (local address 127.15.157.189:37151)
0929 06:40:38.545005 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.545008 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.545023 (+ 15us) server_negotiation.cc:407] Connection header received
0929 06:40:38.545042 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.545043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.545055 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.545116 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.545448 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.546174 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.547206 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.547501 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.547552 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.550910 (+ 3358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.550925 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.550925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.550931 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.552463 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.552826 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.552829 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.552829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.552887 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.553092 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.553092 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.553093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.553230 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.553317 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.553436 (+ 119us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.553557 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":132,"thread_start_us":105,"threads_started":1}
I20260929 06:40:38.554380 29415 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:40:38.554761 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.554646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:46173 (local address 127.0.0.1:54428)
0929 06:40:38.554698 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.554742 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260929 06:40:38.554941 29364 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
I20260929 06:40:38.555346 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.555270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:46173 (local address 127.0.0.1:54438)
0929 06:40:38.555308 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.555331 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260929 06:40:38.555482 29415 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:46173: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.188.keytab.
Entry for principal kudu/127.15.157.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.188.keytab.
I20260929 06:40:38.556546 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.188:46173
--webserver_interface=127.15.157.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.188.keytab
--principal=kudu/127.15.157.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:34403,127.15.157.189:37151,127.15.157.188:46173
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:40:38.590341 29340 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } attempt: 3
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for kudu/127.15.157.189@KRBTEST.COM
I20260929 06:40:38.597635 29420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.590808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42772 (local address 127.15.157.189:37151)
0929 06:40:38.590883 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.590886 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.590911 (+ 25us) server_negotiation.cc:407] Connection header received
0929 06:40:38.590940 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.590941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.590960 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.591025 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.591357 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.591871 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.592592 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.592809 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.592889 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.594998 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.594999 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.595000 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.595008 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.596445 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.596805 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.596806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.596806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.596866 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.597086 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.597087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.597087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.597208 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.597280 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.597458 (+ 178us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.597537 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260929 06:40:38.597635 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.590727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:37151 (local address 127.0.0.1:42772)
0929 06:40:38.590774 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.590786 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:38.590857 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:38.591032 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:38.591033 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:38.591198 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:38.591265 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.591266 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.591978 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.591980 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.592504 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.592506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.592886 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.592887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.592967 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.593453 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:38.593459 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:38.594902 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:38.596552 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.596553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.596554 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.596728 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.596951 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.596952 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.596952 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.597019 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.597283 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:38.597284 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:38.597331 (+ 47us) client_negotiation.cc:769] Sending connection context
0929 06:40:38.597431 (+ 100us) client_negotiation.cc:240] Negotiation successful
0929 06:40:38.597535 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260929 06:40:38.598237 29340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:40:38.598601 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.598508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:46173 (local address 127.0.0.1:54450)
0929 06:40:38.598550 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.598581 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260929 06:40:38.598930 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.598843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:46173 (local address 127.0.0.1:54462)
0929 06:40:38.598886 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.598911 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 06:40:38.599021 29340 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:46173: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
I20260929 06:40:38.604771 29415 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } attempt: 1
I20260929 06:40:38.605233 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.605104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:46173 (local address 127.0.0.1:54474)
0929 06:40:38.605167 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.605206 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260929 06:40:38.605537 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.605449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:46173 (local address 127.0.0.1:54478)
0929 06:40:38.605493 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.605516 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 06:40:38.605625 29415 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:46173: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
I20260929 06:40:38.630173 29340 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } attempt: 1
I20260929 06:40:38.630643 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.630493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:46173 (local address 127.0.0.1:54480)
0929 06:40:38.630582 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.630616 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260929 06:40:38.630983 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.630867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:46173 (local address 127.0.0.1:54496)
0929 06:40:38.630934 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.630957 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260929 06:40:38.631069 29340 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:46173: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
W20260929 06:40:38.638751 29422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:38.638938 29422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:38.638959 29422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:38.640093 29422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:40:38.640136 29422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:38.640149 29422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:38.640206 29422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:40:38.640223 29422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:40:38.642004 29422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:34403,127.15.157.189:37151,127.15.157.188:46173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.188.keytab
--principal=kudu/127.15.157.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.188:46173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.157.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:38.642292 29422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:38.642550 29422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:38.648125 29430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:38.648113 29427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:38.648144 29422 server_base.cc:1034] running on GCE node
W20260929 06:40:38.648116 29428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:38.648567 29422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:38.648870 29422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:38.650101 29422 hybrid_clock.cc:648] HybridClock initialized: now 1790664038650075 us; error 32 us; skew 500 ppm
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:38.652557 29422 init.cc:377] Logged in from keytab as kudu/127.15.157.188@KRBTEST.COM (short username kudu)
I20260929 06:40:38.653070 29422 webserver.cc:460] Webserver started at http://127.15.157.188:37271/ using document root <none> and password file <none>
I20260929 06:40:38.653326 29422 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:38.653396 29422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:38.653549 29422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:40:38.654711 29422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/data/instance:
uuid: "21500c95d7984ab5a511b4df0cb4e289"
format_stamp: "Formatted at 2026-09-29 06:40:38 on dist-test-slave-ltw5"
server_key: "2540e3c026e80ac16bfeb3a9805a125a"
server_key_iv: "29833c85980d092b23f0157774ac7706"
server_key_version: "encryptionkey@0"
I20260929 06:40:38.655072 29422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/wal/instance:
uuid: "21500c95d7984ab5a511b4df0cb4e289"
format_stamp: "Formatted at 2026-09-29 06:40:38 on dist-test-slave-ltw5"
server_key: "2540e3c026e80ac16bfeb3a9805a125a"
server_key_iv: "29833c85980d092b23f0157774ac7706"
server_key_version: "encryptionkey@0"
I20260929 06:40:38.656386 29422 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:40:38.657123 29437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:38.657305 29422 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:40:38.657408 29422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/wal
uuid: "21500c95d7984ab5a511b4df0cb4e289"
format_stamp: "Formatted at 2026-09-29 06:40:38 on dist-test-slave-ltw5"
server_key: "2540e3c026e80ac16bfeb3a9805a125a"
server_key_iv: "29833c85980d092b23f0157774ac7706"
server_key_version: "encryptionkey@0"
I20260929 06:40:38.657490 29422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:38.673779 29415 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } attempt: 2
I20260929 06:40:38.674269 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.674136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:46173 (local address 127.0.0.1:54504)
0929 06:40:38.674201 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.674242 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260929 06:40:38.674602 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.674507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:46173 (local address 127.0.0.1:54512)
0929 06:40:38.674552 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.674577 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 06:40:38.674678 29415 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:46173: Network error: Client connection negotiation failed: client connection to 127.15.157.188:46173: connect: Connection refused (error 111)
I20260929 06:40:38.678623 29422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:38.680469 29422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:38.680630 29422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:38.684626 29422 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.188:46173
I20260929 06:40:38.684679 29489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.188:46173 every 8 connection(s)
I20260929 06:40:38.685091 29422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/data/info.pb
I20260929 06:40:38.685989 29490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:38.687587 29490 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:40:38.691491 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 29422
I20260929 06:40:38.691599 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663890058284-15990-0/minicluster-data/master-2/wal/instance
I20260929 06:40:38.691797 15990 external_mini_cluster.cc:1428] Setting key 0f6ac9ea0cc220eb41d49983aa703870
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.188@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.188@KRBTEST.COM
I20260929 06:40:38.697023 29343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.688327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48612 (local address 127.15.157.190:34403)
0929 06:40:38.688391 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.688393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.688564 (+ 171us) server_negotiation.cc:407] Connection header received
0929 06:40:38.688988 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.688989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.688999 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.689061 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.689657 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.690211 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.691158 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.691338 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.691388 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.694077 (+ 2689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.694079 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.694079 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.694087 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.695599 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.696043 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.696045 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.696045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.696102 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.696371 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.696372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.696372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.696485 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.696565 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.696853 (+ 288us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.696932 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 06:40:38.697239 29492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.688229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:34403 (local address 127.0.0.1:48612)
0929 06:40:38.688442 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.688490 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:38.688908 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:38.689137 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:38.689140 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:38.689387 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:38.689588 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.689592 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.690288 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.690288 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.691085 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.691087 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.691422 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.691423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.691596 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.692443 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:38.692453 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:38.693957 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:38.695710 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.695716 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.695719 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.695951 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.696180 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.696181 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.696182 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.696293 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.696556 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:38.696562 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:38.696718 (+ 156us) client_negotiation.cc:769] Sending connection context
0929 06:40:38.696831 (+ 113us) client_negotiation.cc:240] Negotiation successful
0929 06:40:38.696979 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":105,"threads_started":1}
I20260929 06:40:38.697765 29490 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:40:38.700188 29494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.692233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54518 (local address 127.15.157.188:46173)
0929 06:40:38.692411 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.692416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.692461 (+ 45us) server_negotiation.cc:407] Connection header received
0929 06:40:38.692518 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.692521 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.692543 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.692618 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.693246 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.693971 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.694772 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.695078 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.695160 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.697397 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.697401 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.697402 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.697408 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.699048 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.699377 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.699381 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.699381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.699440 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.699654 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.699654 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.699655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.699834 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.699976 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.700065 (+ 89us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.700122 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":111,"threads_started":1}
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.188@KRBTEST.COM for kudu/127.15.157.189@KRBTEST.COM
I20260929 06:40:38.704785 29492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.698048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:37151 (local address 127.0.0.1:42776)
0929 06:40:38.698082 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.698093 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:38.698134 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:38.698300 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:38.698300 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:38.698452 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:38.698507 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.698509 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.699100 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.699101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.699868 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.699869 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.700368 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.700369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.700448 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.700831 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:38.700837 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:38.702195 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:38.703847 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.703848 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.703849 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.704025 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.704227 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.704228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.704228 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.704284 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.704572 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:38.704572 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:38.704607 (+ 35us) client_negotiation.cc:769] Sending connection context
0929 06:40:38.704659 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 06:40:38.704726 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260929 06:40:38.704877 29420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.698091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42776 (local address 127.15.157.189:37151)
0929 06:40:38.698159 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.698161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.698172 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:40:38.698196 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.698197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.698206 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.698289 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.698589 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.699024 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.699941 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.700239 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.700308 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.702271 (+ 1963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.702273 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.702273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.702280 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.703764 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.704099 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.704100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.704101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.704156 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.704365 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.704366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.704366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.704498 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.704567 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.704700 (+ 133us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.704782 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:38.705258 29490 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:40:38.706203 29340 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } attempt: 2
I20260929 06:40:38.708475 29343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.701008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48614 (local address 127.15.157.190:34403)
0929 06:40:38.701044 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.701045 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.701053 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:40:38.701074 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.701075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.701083 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.701132 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.701656 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.702313 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.702951 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.703244 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.703313 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.705588 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.705589 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.705590 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.705596 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.707116 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.707552 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.707553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.707554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.707609 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.707828 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.707828 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.707829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.707951 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.708105 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.708307 (+ 202us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.708376 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.188@KRBTEST.COM for kudu/127.15.157.188@KRBTEST.COM
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for kudu/127.15.157.188@KRBTEST.COM
I20260929 06:40:38.713306 29492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.705485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:46173 (local address 127.0.0.1:54530)
0929 06:40:38.705532 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.705542 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:38.705578 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:38.705696 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:38.705697 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:38.705843 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:38.705874 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.705876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.706812 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.706812 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.707275 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.707276 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.707767 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.707768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.707814 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.708202 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:38.708207 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:38.709287 (+ 1080us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:38.712239 (+ 2952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.712240 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.712240 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.712475 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.712688 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.712689 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.712689 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.712741 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.712985 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:38.712986 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:38.713022 (+ 36us) client_negotiation.cc:769] Sending connection context
0929 06:40:38.713111 (+ 89us) client_negotiation.cc:240] Negotiation successful
0929 06:40:38.713200 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 06:40:38.713361 29494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.705542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54530 (local address 127.15.157.188:46173)
0929 06:40:38.705575 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.705577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.705585 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:40:38.705635 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.705636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.705645 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.705685 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.705938 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.706725 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.707372 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.707650 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.707724 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.709375 (+ 1651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.709376 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.709376 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.709382 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.711855 (+ 2473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.712563 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.712563 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.712564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.712613 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.712803 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.712804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.712804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.712916 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.712981 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.713132 (+ 151us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.713254 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":19}
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.189@KRBTEST.COM
I20260929 06:40:38.714905 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.706621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:46173 (local address 127.0.0.1:54540)
0929 06:40:38.706680 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.706701 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:38.706730 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:38.707514 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:38.707515 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:38.707672 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:38.707709 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.707711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.708594 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.708594 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.709339 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.709341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.709844 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.709845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.709906 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.710307 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:38.710312 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:38.711697 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:38.713685 (+ 1988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.713686 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.713686 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.713906 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.714225 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.714226 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.714226 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.714289 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.714614 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:38.714615 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:38.714661 (+ 46us) client_negotiation.cc:769] Sending connection context
0929 06:40:38.714738 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 06:40:38.714821 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 06:40:38.714932 29490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289: Bootstrap starting.
I20260929 06:40:38.715037 29495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.707234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54540 (local address 127.15.157.188:46173)
0929 06:40:38.707382 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.707385 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.707392 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:40:38.707411 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.707412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.707422 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.707500 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.707777 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.708497 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.709431 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.709761 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.709836 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.711809 (+ 1973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.711810 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.711810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.711817 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.713542 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.713985 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.713986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.713987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.714082 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.714364 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.714365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.714366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.714533 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.714611 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.714783 (+ 172us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.714865 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":92,"threads_started":1}
I20260929 06:40:38.715731 29490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:38.716041 29490 log.cc:824] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:38.717021 29490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289: No bootstrap required, opened a new log
I20260929 06:40:38.717217 29340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d: Bootstrap starting.
I20260929 06:40:38.717686 29420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.709220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42792 (local address 127.15.157.189:37151)
0929 06:40:38.709251 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.709253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.709317 (+ 64us) server_negotiation.cc:407] Connection header received
0929 06:40:38.709429 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.709430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.709441 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.709496 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.710085 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.710514 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.711353 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.711664 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.711750 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.714883 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.714884 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.714885 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.714891 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.716456 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.716836 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.716837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.716837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.716881 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.717092 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.717093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.717094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.717225 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.717433 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.717510 (+ 77us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.717580 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260929 06:40:38.717890 29340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:38.718240 29340 log.cc:824] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:38.719044 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:40:38.719132 29340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d: No bootstrap required, opened a new log
I20260929 06:40:38.719138 29490 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } }
I20260929 06:40:38.719293 29490 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:38.719336 29490 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21500c95d7984ab5a511b4df0cb4e289, State: Initialized, Role: FOLLOWER
I20260929 06:40:38.719446 29490 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } }
I20260929 06:40:38.719751 29490 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:40:38.721483 29340 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } }
I20260929 06:40:38.721623 29340 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:38.721668 29340 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d492054457a45649460980d7029659d, State: Initialized, Role: FOLLOWER
I20260929 06:40:38.721783 29340 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } }
I20260929 06:40:38.722095 29340 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [sys.catalog]: configured and running, proceeding with master startup.
W20260929 06:40:38.723987 29528 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:40:38.724092 29528 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:40:38.721722 29422 master_runner.cc:186] Error getting master registration for 127.15.157.190:34403: OK, instance_id { permanent_uuid: "5d492054457a45649460980d7029659d" instance_seqno: 1790664038361396 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 06:40:38.725044 29422 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 06:40:38.725172 29498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } } }
I20260929 06:40:38.725265 29498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [sys.catalog]: This master's current role is: FOLLOWER
W20260929 06:40:38.725828 29516 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:40:38.725884 29516 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:40:38.726203 29517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } } }
I20260929 06:40:38.726647 29517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:40:38.724651 29272 master_runner.cc:186] Error getting master registration for 127.15.157.189:37151: OK, instance_id { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" instance_seqno: 1790664038526268 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 06:40:38.727632 29272 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 06:40:38.731073 29420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.720755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42804 (local address 127.15.157.189:37151)
0929 06:40:38.720791 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.720793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.721163 (+ 370us) server_negotiation.cc:407] Connection header received
0929 06:40:38.721259 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.721260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.721270 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.721299 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.722292 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.722970 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.724776 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.725070 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.725131 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.727712 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.727713 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.727714 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.727721 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.729376 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.729783 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.729785 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.729785 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.729840 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.730477 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.730478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.730479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.730616 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.730691 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.730898 (+ 207us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.730978 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:40:38.731092 29343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.720533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48622 (local address 127.15.157.190:34403)
0929 06:40:38.720575 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.720577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.720683 (+ 106us) server_negotiation.cc:407] Connection header received
0929 06:40:38.720902 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.720903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.720915 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.720947 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.722154 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.722922 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.724815 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.725100 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.725136 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.727627 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.727629 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.727629 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.727637 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.729799 (+ 2162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.730247 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.730248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.730249 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.730308 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.730513 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.730513 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.730514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.730637 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.730727 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.730929 (+ 202us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.731003 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:40:38.738123 29495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.721014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54542 (local address 127.15.157.188:46173)
0929 06:40:38.721049 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.721051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.725764 (+ 4713us) server_negotiation.cc:407] Connection header received
0929 06:40:38.728062 (+ 2298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.728063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.728076 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.728106 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.731322 (+ 3216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.732068 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.733196 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.733516 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.733558 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.735099 (+ 1541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.735101 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.735101 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.735108 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.736822 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.737242 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.737243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.737243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.737298 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.737502 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.737503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.737504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.737627 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.737712 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.737918 (+ 206us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.738004 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:40:38.765832 29415 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } attempt: 3
I20260929 06:40:38.765995 29498 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:40:38.766147 29498 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } }
I20260929 06:40:38.766408 29498 leader_election.cc:288] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d492054457a45649460980d7029659d (127.15.157.190:34403), 71b2958670ea4fa88a54b351ad4454b2 (127.15.157.189:37151)
I20260929 06:40:38.766992 29314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21500c95d7984ab5a511b4df0cb4e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d492054457a45649460980d7029659d" is_pre_election: true
I20260929 06:40:38.767134 29314 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21500c95d7984ab5a511b4df0cb4e289 in term 0.
I20260929 06:40:38.767596 29440 leader_election.cc:302] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21500c95d7984ab5a511b4df0cb4e289, 5d492054457a45649460980d7029659d; no voters:
I20260929 06:40:38.767838 29498 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:40:38.767903 29498 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:40:38.767926 29498 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:40:38.768836 29498 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } }
I20260929 06:40:38.768945 29498 leader_election.cc:288] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [CANDIDATE]: Term 1 election: Requested vote from peers 5d492054457a45649460980d7029659d (127.15.157.190:34403), 71b2958670ea4fa88a54b351ad4454b2 (127.15.157.189:37151)
I20260929 06:40:38.769573 29314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21500c95d7984ab5a511b4df0cb4e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d492054457a45649460980d7029659d"
I20260929 06:40:38.769677 29314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:40:38.770591 29314 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21500c95d7984ab5a511b4df0cb4e289 in term 1.
I20260929 06:40:38.770758 29440 leader_election.cc:302] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21500c95d7984ab5a511b4df0cb4e289, 5d492054457a45649460980d7029659d; no voters:
Sep 29 06:40:38 dist-test-slave-ltw5 krb5kdc[29259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664038, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.189@KRBTEST.COM for kudu/127.15.157.188@KRBTEST.COM
I20260929 06:40:38.771617 29498 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:40:38.771795 29498 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [term 1 LEADER]: Becoming Leader. State: Replica: 21500c95d7984ab5a511b4df0cb4e289, State: Running, Role: LEADER
I20260929 06:40:38.771906 29498 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } }
I20260929 06:40:38.772289 29498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21500c95d7984ab5a511b4df0cb4e289. Latest consensus state: current_term: 1 leader_uuid: "21500c95d7984ab5a511b4df0cb4e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } } }
I20260929 06:40:38.772361 29498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:38.772590 29533 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:40:38.773016 29533 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:40:38.775511 29314 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [term 1 FOLLOWER]: Refusing update from remote peer 21500c95d7984ab5a511b4df0cb4e289: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:40:38.775868 29498 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:40:38.776467 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.766141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:46173 (local address 127.0.0.1:54554)
0929 06:40:38.766226 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:38.766237 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:38.766275 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:38.766538 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:38.766539 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:38.766733 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:38.766786 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.766787 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.767710 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.767711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.768519 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:38.768521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.769016 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.769017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:38.769088 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.769881 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:38.769886 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:38.771573 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:38.774825 (+ 3252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.774826 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.774827 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.775055 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.775407 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:38.775408 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:38.775409 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:38.775483 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:38.776154 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:38.776155 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:38.776227 (+ 72us) client_negotiation.cc:769] Sending connection context
0929 06:40:38.776278 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 06:40:38.776383 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260929 06:40:38.777208 29517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21500c95d7984ab5a511b4df0cb4e289. Latest consensus state: current_term: 1 leader_uuid: "21500c95d7984ab5a511b4df0cb4e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } } }
I20260929 06:40:38.777311 29517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:40:38.777299 29495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:38.766358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54554 (local address 127.15.157.188:46173)
0929 06:40:38.766407 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:38.766408 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:38.766415 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:40:38.766436 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:38.766437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:38.766446 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:38.766491 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:38.766861 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.767619 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.768611 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:38.768906 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:38.768964 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:38.771782 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:38.771783 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:38.771784 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:38.771791 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:38.774675 (+ 2884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.775150 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.775151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.775151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.775278 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:38.775557 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:38.775558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:38.775559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:38.775919 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:38.776929 (+ 1010us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:38.776996 (+ 67us) server_negotiation.cc:299] Negotiation successful
0929 06:40:38.777118 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:40:38.778497 29498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "21500c95d7984ab5a511b4df0cb4e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } } }
I20260929 06:40:38.778574 29498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:38.778963 29517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "21500c95d7984ab5a511b4df0cb4e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } } }
I20260929 06:40:38.779033 29517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:40:38.779052 29415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2: Bootstrap starting.
I20260929 06:40:38.779261 29534 mvcc.cc:205] Tried to move back new op lower bound from 7334559902820114432 to 7334559902810353664. Current Snapshot: MvccSnapshot[applied={T|T < 7334559902820114432}]
I20260929 06:40:38.779768 29415 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:38.780053 29415 log.cc:824] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:38.780082 29535 mvcc.cc:205] Tried to move back new op lower bound from 7334559902820114432 to 7334559902810353664. Current Snapshot: MvccSnapshot[applied={T|T < 7334559902820114432}]
I20260929 06:40:38.780735 29533 catalog_manager.cc:1347] Generated new cluster ID: ee8d42482fea4d20bb4b6aff92e594a6
I20260929 06:40:38.780786 29533 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:40:38.781270 29415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2: No bootstrap required, opened a new log
I20260929 06:40:38.783258 29415 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } }
I20260929 06:40:38.783381 29415 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:38.783412 29415 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b2958670ea4fa88a54b351ad4454b2, State: Initialized, Role: FOLLOWER
I20260929 06:40:38.783522 29415 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } }
I20260929 06:40:38.783788 29415 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:40:38.785032 29388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21500c95d7984ab5a511b4df0cb4e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b2958670ea4fa88a54b351ad4454b2"
I20260929 06:40:38.785667 29388 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [term 0 FOLLOWER]: Advancing to term 1
W20260929 06:40:38.785935 29551 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:40:38.786041 29551 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:40:38.786855 29388 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21500c95d7984ab5a511b4df0cb4e289 in term 1.
I20260929 06:40:38.785125 29389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21500c95d7984ab5a511b4df0cb4e289" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b2958670ea4fa88a54b351ad4454b2" is_pre_election: true
I20260929 06:40:38.786995 29389 raft_consensus.cc:2362] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 21500c95d7984ab5a511b4df0cb4e289 in term 1. Re-sending same reply.
I20260929 06:40:38.787052 29540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } } }
I20260929 06:40:38.787184 29540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:40:38.788057 29387 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [term 1 FOLLOWER]: Refusing update from remote peer 21500c95d7984ab5a511b4df0cb4e289: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:40:38.789211 29531 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:40:38.791249 29540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21500c95d7984ab5a511b4df0cb4e289. Latest consensus state: current_term: 1 leader_uuid: "21500c95d7984ab5a511b4df0cb4e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } } }
I20260929 06:40:38.791329 29540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:40:38.791361 29540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "21500c95d7984ab5a511b4df0cb4e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } } }
I20260929 06:40:38.791416 29540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:40:38.797945 29553 mvcc.cc:205] Tried to move back new op lower bound from 7334559902820114432 to 7334559902810353664. Current Snapshot: MvccSnapshot[applied={T|T < 7334559902820114432}]
I20260929 06:40:38.800666 29498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "21500c95d7984ab5a511b4df0cb4e289" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d492054457a45649460980d7029659d" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34403 } } peers { permanent_uuid: "71b2958670ea4fa88a54b351ad4454b2" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 37151 } } peers { permanent_uuid: "21500c95d7984ab5a511b4df0cb4e289" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 46173 } } }
I20260929 06:40:38.800760 29498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289 [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:38.803714 29533 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:40:38.804388 29533 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:40:38.813239 29533 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21500c95d7984ab5a511b4df0cb4e289: Generated new TSK 0
I20260929 06:40:38.813414 29533 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:40:39.724555 29528 catalog_manager.cc:1259] Loaded cluster ID: ee8d42482fea4d20bb4b6aff92e594a6
I20260929 06:40:39.724627 29528 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d: loading cluster ID for follower catalog manager: success
I20260929 06:40:39.725457 29528 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d: acquiring CA information for follower catalog manager: success
I20260929 06:40:39.725780 29528 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5d492054457a45649460980d7029659d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:40:39.786485 29551 catalog_manager.cc:1259] Loaded cluster ID: ee8d42482fea4d20bb4b6aff92e594a6
I20260929 06:40:39.786564 29551 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2: loading cluster ID for follower catalog manager: success
I20260929 06:40:39.787423 29551 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2: acquiring CA information for follower catalog manager: success
I20260929 06:40:39.787740 29551 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 71b2958670ea4fa88a54b351ad4454b2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:40:39.878652 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 29272
I20260929 06:40:39.883885 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 29347
I20260929 06:40:39.888828 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 29422
2026-09-29T06:40:39Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2808 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:40:39 dist-test-slave-ltw5 krb5kdc[29566](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:40:39 dist-test-slave-ltw5 krb5kdc[29566](info): set up 2 sockets
Sep 29 06:40:39 dist-test-slave-ltw5 krb5kdc[29566](info): commencing operation
krb5kdc: starting...
W20260929 06:40:40.926155 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:40:41 dist-test-slave-ltw5 krb5kdc[29566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:40:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:40:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:40:41.045441 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:40641
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:40641
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:41.126200 29579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:41.126471 29579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:41.126515 29579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:41.127789 29579 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:40:41.127880 29579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:41.127905 29579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:41.127928 29579 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:40:41.127957 29579 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:40:41.129532 29579 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:40641
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:40641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:41.129832 29579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:41.130101 29579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:41.134979 29585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:41.135547 29584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:41.135546 29587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:41.135639 29579 server_base.cc:1034] running on GCE node
I20260929 06:40:41.135998 29579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:41.136246 29579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:41.137396 29579 hybrid_clock.cc:648] HybridClock initialized: now 1790664041137369 us; error 43 us; skew 500 ppm
Sep 29 06:40:41 dist-test-slave-ltw5 krb5kdc[29566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664041, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:41.140048 29579 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:40:41.140489 29579 webserver.cc:460] Webserver started at http://127.15.157.190:44551/ using document root <none> and password file <none>
I20260929 06:40:41.140730 29579 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:41.140775 29579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:41.140929 29579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:40:41.142107 29579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "5673400a289e433a8997f05c39a2ab1a"
format_stamp: "Formatted at 2026-09-29 06:40:41 on dist-test-slave-ltw5"
server_key: "85355fe92dc600815970c7e1bbab7bb1"
server_key_iv: "5375b101a8d27605a5c42ccc90d0b12d"
server_key_version: "encryptionkey@0"
I20260929 06:40:41.142508 29579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "5673400a289e433a8997f05c39a2ab1a"
format_stamp: "Formatted at 2026-09-29 06:40:41 on dist-test-slave-ltw5"
server_key: "85355fe92dc600815970c7e1bbab7bb1"
server_key_iv: "5375b101a8d27605a5c42ccc90d0b12d"
server_key_version: "encryptionkey@0"
I20260929 06:40:41.144212 29579 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:40:41.144971 29594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:41.145123 29579 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:40:41.145236 29579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "5673400a289e433a8997f05c39a2ab1a"
format_stamp: "Formatted at 2026-09-29 06:40:41 on dist-test-slave-ltw5"
server_key: "85355fe92dc600815970c7e1bbab7bb1"
server_key_iv: "5375b101a8d27605a5c42ccc90d0b12d"
server_key_version: "encryptionkey@0"
I20260929 06:40:41.145327 29579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:41.152652 29579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:41.155054 29579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:41.155222 29579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:41.159072 29579 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:40641
I20260929 06:40:41.159106 29646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:40641 every 8 connection(s)
I20260929 06:40:41.159477 29579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:40:41.160297 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 29579
I20260929 06:40:41.160369 29647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:41.160415 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:40:41.160606 15990 external_mini_cluster.cc:1428] Setting key af1f75c307ec2aab735aedcb9181519b
I20260929 06:40:41.163518 29647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a: Bootstrap starting.
I20260929 06:40:41.164276 29647 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:41.164575 29647 log.cc:824] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:41.165313 29647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a: No bootstrap required, opened a new log
Sep 29 06:40:41 dist-test-slave-ltw5 krb5kdc[29566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:41.168002 29647 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5673400a289e433a8997f05c39a2ab1a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40641 } }
I20260929 06:40:41.168169 29647 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:41.168218 29647 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5673400a289e433a8997f05c39a2ab1a, State: Initialized, Role: FOLLOWER
I20260929 06:40:41.168361 29647 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5673400a289e433a8997f05c39a2ab1a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40641 } }
I20260929 06:40:41.168462 29647 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:40:41.168505 29647 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:40:41.168550 29647 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:40:41.169094 29647 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5673400a289e433a8997f05c39a2ab1a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40641 } }
I20260929 06:40:41.169217 29647 leader_election.cc:302] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5673400a289e433a8997f05c39a2ab1a; no voters:
I20260929 06:40:41.169389 29647 leader_election.cc:288] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:40:41.169443 29652 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:40:41.169546 29652 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [term 1 LEADER]: Becoming Leader. State: Replica: 5673400a289e433a8997f05c39a2ab1a, State: Running, Role: LEADER
I20260929 06:40:41.169628 29652 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5673400a289e433a8997f05c39a2ab1a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40641 } }
I20260929 06:40:41.169667 29647 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:40:41.169967 29652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5673400a289e433a8997f05c39a2ab1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5673400a289e433a8997f05c39a2ab1a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40641 } } }
I20260929 06:40:41.170069 29652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:41.170558 29653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5673400a289e433a8997f05c39a2ab1a. Latest consensus state: current_term: 1 leader_uuid: "5673400a289e433a8997f05c39a2ab1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5673400a289e433a8997f05c39a2ab1a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40641 } } }
I20260929 06:40:41.170632 29653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:41.170645 29661 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:40:41.171145 29661 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:40:41.172392 29650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:41.161148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48856 (local address 127.15.157.190:40641)
0929 06:40:41.161302 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:41.161310 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:41.161335 (+ 25us) server_negotiation.cc:407] Connection header received
0929 06:40:41.161815 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:41.161822 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:41.161872 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:41.161987 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:41.162806 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:41.163721 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:41.164812 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:41.165328 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:41.165479 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:41.168187 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:41.168209 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:41.168209 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:41.168223 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:41.170298 (+ 2075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:41.170720 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:41.170722 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:41.170723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:41.170820 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:41.171059 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:41.171060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:41.171060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:41.171403 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:41.172041 (+ 638us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:41.172105 (+ 64us) server_negotiation.cc:299] Negotiation successful
0929 06:40:41.172208 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":75,"threads_started":1}
I20260929 06:40:41.172781 29661 catalog_manager.cc:1347] Generated new cluster ID: 13873cea77194dfaab8884c0411ed5ce
I20260929 06:40:41.172827 29661 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:40:41.173216 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:40:41.181753 29661 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:40:41.182376 29661 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:40:41.191603 29661 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5673400a289e433a8997f05c39a2ab1a: Generated new TSK 0
I20260929 06:40:41.191799 29661 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:40:41.227233 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 29579
2026-09-29T06:40:41Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1336 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:40:41 dist-test-slave-ltw5 krb5kdc[29674](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:40:41 dist-test-slave-ltw5 krb5kdc[29674](info): set up 2 sockets
Sep 29 06:40:41 dist-test-slave-ltw5 krb5kdc[29674](info): commencing operation
krb5kdc: starting...
W20260929 06:40:42.258270 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:40:42 dist-test-slave-ltw5 krb5kdc[29674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:40:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:40:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:40:42.377683 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:46181
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:46181
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:42.457476 29687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:42.457679 29687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:42.457700 29687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:42.458863 29687 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:40:42.458906 29687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:42.458921 29687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:42.458935 29687 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:40:42.458993 29687 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:40:42.460435 29687 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:46181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:46181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:42.460683 29687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:42.460906 29687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:42.465821 29692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:42.465813 29693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:42.465847 29687 server_base.cc:1034] running on GCE node
W20260929 06:40:42.465817 29695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:42.466352 29687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:42.466704 29687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:42.467878 29687 hybrid_clock.cc:648] HybridClock initialized: now 1790664042467873 us; error 34 us; skew 500 ppm
Sep 29 06:40:42 dist-test-slave-ltw5 krb5kdc[29674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664042, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:42.470250 29687 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:40:42.470714 29687 webserver.cc:460] Webserver started at http://127.15.157.190:45775/ using document root <none> and password file <none>
I20260929 06:40:42.470952 29687 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:42.471021 29687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:42.471154 29687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:40:42.472195 29687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "14ee6cf173b14724b23b3ba966b305ee"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "cbcbe33fc31594fec6dc8e2a147fea19"
server_key_iv: "c96c647d9383a5f5abfa59c3fef608bf"
server_key_version: "encryptionkey@0"
I20260929 06:40:42.472555 29687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "14ee6cf173b14724b23b3ba966b305ee"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "cbcbe33fc31594fec6dc8e2a147fea19"
server_key_iv: "c96c647d9383a5f5abfa59c3fef608bf"
server_key_version: "encryptionkey@0"
I20260929 06:40:42.473798 29687 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:40:42.474567 29702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:42.474771 29687 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:42.474866 29687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "14ee6cf173b14724b23b3ba966b305ee"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "cbcbe33fc31594fec6dc8e2a147fea19"
server_key_iv: "c96c647d9383a5f5abfa59c3fef608bf"
server_key_version: "encryptionkey@0"
I20260929 06:40:42.474953 29687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:42.486348 29687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:42.488006 29687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:42.488157 29687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:42.492157 29687 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:46181
I20260929 06:40:42.492198 29754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:46181 every 8 connection(s)
I20260929 06:40:42.492501 29687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:40:42.493366 29755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:42.495606 29755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Bootstrap starting.
I20260929 06:40:42.496183 29755 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:42.496459 29755 log.cc:824] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:42.497117 29755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: No bootstrap required, opened a new log
I20260929 06:40:42.498812 29755 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } }
I20260929 06:40:42.498968 29755 raft_consensus.cc:374] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:42.499015 29755 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ee6cf173b14724b23b3ba966b305ee, State: Initialized, Role: FOLLOWER
I20260929 06:40:42.499184 29755 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } }
I20260929 06:40:42.499264 29755 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:40:42.499306 29755 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:40:42.499356 29755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:40:42.500118 29755 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } }
I20260929 06:40:42.500242 29755 leader_election.cc:302] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14ee6cf173b14724b23b3ba966b305ee; no voters:
I20260929 06:40:42.500409 29755 leader_election.cc:288] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:40:42.500442 29758 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:40:42.500669 29755 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:40:42.500765 29758 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 1 LEADER]: Becoming Leader. State: Replica: 14ee6cf173b14724b23b3ba966b305ee, State: Running, Role: LEADER
I20260929 06:40:42.500885 29758 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } }
I20260929 06:40:42.501366 29760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14ee6cf173b14724b23b3ba966b305ee. Latest consensus state: current_term: 1 leader_uuid: "14ee6cf173b14724b23b3ba966b305ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } } }
I20260929 06:40:42.501462 29760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:42.501672 29767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:40:42.501796 29759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "14ee6cf173b14724b23b3ba966b305ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } } }
I20260929 06:40:42.501889 29759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:42.502172 29767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:40:42.502362 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 29687
I20260929 06:40:42.502481 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:40:42.502672 15990 external_mini_cluster.cc:1428] Setting key e1e1c915e93fbed4ecf6a4003e55c033
I20260929 06:40:42.504364 29767 catalog_manager.cc:1347] Generated new cluster ID: 90fb06c9be1b494c906355145098431f
I20260929 06:40:42.504419 29767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:40:42 dist-test-slave-ltw5 krb5kdc[29674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:42.512603 29777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:42.503113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41710 (local address 127.15.157.190:46181)
0929 06:40:42.503615 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:42.503624 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:42.503652 (+ 28us) server_negotiation.cc:407] Connection header received
0929 06:40:42.503758 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:42.503765 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:42.503819 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:42.503961 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:42.504701 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:42.505684 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:42.506489 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:42.506918 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:42.507057 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:42.509317 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:42.509321 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:42.509321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:42.509333 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:42.511037 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:42.511408 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:42.511411 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:42.511411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:42.511510 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:42.511729 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:42.511730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:42.511730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:42.511959 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:42.512125 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:42.512216 (+ 91us) server_negotiation.cc:299] Negotiation successful
0929 06:40:42.512451 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":73,"threads_started":1}
I20260929 06:40:42.526046 29767 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:40:42.526660 29767 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:40:42.532639 29767 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Generated new TSK 0
I20260929 06:40:42.532857 29767 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:40:42.565900 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46181
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:42.664796 29781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:42.665016 29781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:42.665056 29781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:42.666252 29781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:42.666311 29781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:42.666354 29781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:40:42.667795 29781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:42.668068 29781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:42.668285 29781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:42.673341 29789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:42.673348 29781 server_base.cc:1034] running on GCE node
W20260929 06:40:42.673316 29787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:42.673309 29786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:42.673766 29781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:42.673954 29781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:42.675138 29781 hybrid_clock.cc:648] HybridClock initialized: now 1790664042675137 us; error 46 us; skew 500 ppm
Sep 29 06:40:42 dist-test-slave-ltw5 krb5kdc[29674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664042, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:42.677521 29781 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:40:42.677991 29781 webserver.cc:460] Webserver started at http://127.15.157.129:36209/ using document root <none> and password file <none>
I20260929 06:40:42.678267 29781 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:42.678340 29781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:42.678491 29781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:40:42.679587 29781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "69fe84eb7d9246c1ba2f4ccca615b22a"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "4ced4a8130e94683a1cdda8c10a985b4"
server_key_iv: "ad865e13219aa432d0896623bf049747"
server_key_version: "encryptionkey@0"
I20260929 06:40:42.679968 29781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "69fe84eb7d9246c1ba2f4ccca615b22a"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "4ced4a8130e94683a1cdda8c10a985b4"
server_key_iv: "ad865e13219aa432d0896623bf049747"
server_key_version: "encryptionkey@0"
I20260929 06:40:42.681301 29781 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:40:42.681957 29796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:42.682157 29781 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:40:42.682253 29781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "69fe84eb7d9246c1ba2f4ccca615b22a"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "4ced4a8130e94683a1cdda8c10a985b4"
server_key_iv: "ad865e13219aa432d0896623bf049747"
server_key_version: "encryptionkey@0"
I20260929 06:40:42.682339 29781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:42.703173 29781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:42.705036 29781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:42.705206 29781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:42.705449 29781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:42.705785 29781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:40:42.705839 29781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:42.705875 29781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:40:42.705904 29781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:42.711941 29781 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:34565
I20260929 06:40:42.711997 29909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:34565 every 8 connection(s)
I20260929 06:40:42.712327 29781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:40:42 dist-test-slave-ltw5 krb5kdc[29674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664042, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:42.720992 29777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:42.713084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:58861 (local address 127.15.157.190:46181)
0929 06:40:42.713163 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:42.713165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:42.713362 (+ 197us) server_negotiation.cc:407] Connection header received
0929 06:40:42.713817 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:42.713818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:42.713830 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:42.713890 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:42.714869 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:42.715370 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:42.716302 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:42.716488 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:42.716538 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:42.718564 (+ 2026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:42.718565 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:42.718565 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:42.718572 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:42.719938 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:42.720264 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:42.720265 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:42.720265 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:42.720311 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:42.720509 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:42.720510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:42.720511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:42.720602 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:42.720650 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:42.720866 (+ 216us) server_negotiation.cc:299] Negotiation successful
0929 06:40:42.720929 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260929 06:40:42.721144 29912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:42.713019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:58861)
0929 06:40:42.713230 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:42.713271 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:42.713736 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:42.713945 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:42.713948 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:42.714597 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:42.714785 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:42.714789 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:42.715447 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:42.715447 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:42.716228 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:42.716229 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:42.716558 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:42.716559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:42.716654 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:42.717106 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:42.717114 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:42.718484 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:42.720004 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:42.720009 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:42.720010 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:42.720202 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:42.720368 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:42.720369 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:42.720369 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:42.720458 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:42.720655 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:42.720659 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:42.720763 (+ 104us) client_negotiation.cc:769] Sending connection context
0929 06:40:42.720850 (+ 87us) client_negotiation.cc:240] Negotiation successful
0929 06:40:42.720958 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":90,"threads_started":1}
I20260929 06:40:42.721472 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 29781
I20260929 06:40:42.721593 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:40:42.721714 29910 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46181
I20260929 06:40:42.721798 15990 external_mini_cluster.cc:1428] Setting key 66c760ab1ac36ca98be7f0a63a83af9e
I20260929 06:40:42.721809 29910 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:42.722000 29910 heartbeater.cc:511] Master 127.15.157.190:46181 requested a full tablet report, sending...
I20260929 06:40:42.722620 29718 ts_manager.cc:194] Registered new tserver with Master: 69fe84eb7d9246c1ba2f4ccca615b22a (127.15.157.129:34565)
I20260929 06:40:42.723223 29718 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:58861
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:40:42.745549 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46181
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:42.826176 29915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:42.826375 29915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:42.826398 29915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:42.827467 29915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:42.827500 29915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:42.827526 29915 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:40:42.828872 29915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:42.829049 29915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:42.829223 29915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:42.834136 29920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:42.834228 29921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:42.834090 29923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:42.834331 29915 server_base.cc:1034] running on GCE node
I20260929 06:40:42.834518 29915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:42.834712 29915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:42.835847 29915 hybrid_clock.cc:648] HybridClock initialized: now 1790664042835832 us; error 32 us; skew 500 ppm
Sep 29 06:40:42 dist-test-slave-ltw5 krb5kdc[29674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664042, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:42.838483 29915 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:40:42.838963 29915 webserver.cc:460] Webserver started at http://127.15.157.130:43747/ using document root <none> and password file <none>
I20260929 06:40:42.839228 29915 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:42.839298 29915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:42.839443 29915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:40:42.840463 29915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "958e2f20914b4e14898b44881cd0c40c"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "fb148b4e226936592e1729156b5ff2cb"
server_key_iv: "3cac02eb8d5ab92834451d73b84405b5"
server_key_version: "encryptionkey@0"
I20260929 06:40:42.840816 29915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "958e2f20914b4e14898b44881cd0c40c"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "fb148b4e226936592e1729156b5ff2cb"
server_key_iv: "3cac02eb8d5ab92834451d73b84405b5"
server_key_version: "encryptionkey@0"
I20260929 06:40:42.842170 29915 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:40:42.842882 29930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:42.843050 29915 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:40:42.843169 29915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "958e2f20914b4e14898b44881cd0c40c"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "fb148b4e226936592e1729156b5ff2cb"
server_key_iv: "3cac02eb8d5ab92834451d73b84405b5"
server_key_version: "encryptionkey@0"
I20260929 06:40:42.843242 29915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:42.860234 29915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:42.862105 29915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:42.862273 29915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:42.862509 29915 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:42.862815 29915 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:40:42.862870 29915 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:42.862910 29915 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:40:42.862938 29915 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:42.868778 29915 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:40665
I20260929 06:40:42.868824 30043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:40665 every 8 connection(s)
I20260929 06:40:42.869130 29915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:40:42.870179 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 29915
I20260929 06:40:42.870283 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:40:42.870471 15990 external_mini_cluster.cc:1428] Setting key d13ea16408431c73043d033f4175d8e1
Sep 29 06:40:42 dist-test-slave-ltw5 krb5kdc[29674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664042, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
I20260929 06:40:42.879599 29777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:42.869857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:47605 (local address 127.15.157.190:46181)
0929 06:40:42.869920 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:42.869922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:42.870181 (+ 259us) server_negotiation.cc:407] Connection header received
0929 06:40:42.870883 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:42.870884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:42.870894 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:42.870943 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:42.872204 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:42.872769 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:42.873811 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:42.874077 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:42.874176 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:42.876462 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:42.876464 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:42.876464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:42.876471 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:42.878097 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:42.878586 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:42.878588 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:42.878588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:42.878649 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:42.878893 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:42.878894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:42.878894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:42.879050 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:42.879116 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:42.879416 (+ 300us) server_negotiation.cc:299] Negotiation successful
0929 06:40:42.879526 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 06:40:42.879777 30046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:42.869844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:47605)
0929 06:40:42.870006 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:42.870069 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:42.870760 (+ 691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:42.871018 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:42.871022 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:42.871814 (+ 792us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:42.872097 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:42.872104 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:42.872895 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:42.872896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:42.873715 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:42.873717 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:42.874188 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:42.874189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:42.874351 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:42.874977 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:42.874990 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:42.876367 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:42.878189 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:42.878195 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:42.878197 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:42.878490 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:42.878729 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:42.878729 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:42.878730 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:42.878825 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:42.879119 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:42.879123 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:42.879286 (+ 163us) client_negotiation.cc:769] Sending connection context
0929 06:40:42.879370 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 06:40:42.879529 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":76,"threads_started":1}
I20260929 06:40:42.880230 30044 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46181
I20260929 06:40:42.880342 30044 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:42.880493 30044 heartbeater.cc:511] Master 127.15.157.190:46181 requested a full tablet report, sending...
I20260929 06:40:42.880861 29718 ts_manager.cc:194] Registered new tserver with Master: 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665)
I20260929 06:40:42.881187 29718 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:47605
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:40:42.896873 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46181
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:42.976349 30049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:42.976539 30049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:42.976562 30049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:42.977619 30049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:42.977653 30049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:42.977679 30049 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:40:42.979079 30049 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:42.979310 30049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:42.979511 30049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:42.984346 30055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:42.984354 30054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:42.984436 30049 server_base.cc:1034] running on GCE node
W20260929 06:40:42.984347 30057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:42.984825 30049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:42.985111 30049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:42.986251 30049 hybrid_clock.cc:648] HybridClock initialized: now 1790664042986242 us; error 32 us; skew 500 ppm
Sep 29 06:40:42 dist-test-slave-ltw5 krb5kdc[29674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664042, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:42.988654 30049 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:40:42.989085 30049 webserver.cc:460] Webserver started at http://127.15.157.131:46089/ using document root <none> and password file <none>
I20260929 06:40:42.989324 30049 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:42.989394 30049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:42.989544 30049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:40:42.990610 30049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "cd6a671e9a7a43b48640b45cf4cae2c5"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "fa7dabf73560faaf533cea6f759b63e5"
server_key_iv: "dda3a26891ce1132057f070e3e9823d0"
server_key_version: "encryptionkey@0"
I20260929 06:40:42.990980 30049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "cd6a671e9a7a43b48640b45cf4cae2c5"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "fa7dabf73560faaf533cea6f759b63e5"
server_key_iv: "dda3a26891ce1132057f070e3e9823d0"
server_key_version: "encryptionkey@0"
I20260929 06:40:42.992251 30049 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:40:42.992911 30064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:42.993074 30049 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:40:42.993175 30049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "cd6a671e9a7a43b48640b45cf4cae2c5"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "fa7dabf73560faaf533cea6f759b63e5"
server_key_iv: "dda3a26891ce1132057f070e3e9823d0"
server_key_version: "encryptionkey@0"
I20260929 06:40:42.993248 30049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:43.011721 30049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:43.014298 30049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:43.014456 30049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:43.014691 30049 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:43.015022 30049 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:40:43.015077 30049 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:43.015121 30049 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:40:43.015146 30049 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:43.020812 30049 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:43181
I20260929 06:40:43.020857 30177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:43181 every 8 connection(s)
I20260929 06:40:43.021207 30049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:40:43.021608 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 30049
I20260929 06:40:43.021703 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:40:43.021919 15990 external_mini_cluster.cc:1428] Setting key d05781dd1f4ad0857916c0455fb149cf
Sep 29 06:40:43 dist-test-slave-ltw5 krb5kdc[29674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664042, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:43.030591 29777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.021991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:41583 (local address 127.15.157.190:46181)
0929 06:40:43.022108 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.022110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.022300 (+ 190us) server_negotiation.cc:407] Connection header received
0929 06:40:43.022993 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.022994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.023003 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.023045 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:43.024031 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.024517 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.025556 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.025747 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.025802 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.027885 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:43.027887 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:43.027887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:43.027893 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:43.029082 (+ 1189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:43.029458 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:43.029459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:43.029459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:43.029529 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:43.029952 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:43.029952 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:43.029953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:43.030106 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:43.030158 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.030404 (+ 246us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.030474 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260929 06:40:43.030691 30180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.021944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:41583)
0929 06:40:43.022135 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.022185 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:43.022890 (+ 705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:43.023100 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:43.023103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:43.023756 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:43.023953 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.023958 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.024594 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.024595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.025475 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.025477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.025822 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.025823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.025920 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.026408 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:43.026417 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:43.027797 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:43.029154 (+ 1357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:43.029160 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:43.029161 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:43.029382 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:43.029590 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:43.029591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:43.029591 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:43.029869 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:43.030152 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:43.030157 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:43.030286 (+ 129us) client_negotiation.cc:769] Sending connection context
0929 06:40:43.030378 (+ 92us) client_negotiation.cc:240] Negotiation successful
0929 06:40:43.030497 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":101,"threads_started":1}
I20260929 06:40:43.031208 30178 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46181
I20260929 06:40:43.031314 30178 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:43.031493 30178 heartbeater.cc:511] Master 127.15.157.190:46181 requested a full tablet report, sending...
I20260929 06:40:43.031903 29718 ts_manager.cc:194] Registered new tserver with Master: cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181)
I20260929 06:40:43.032274 29718 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:41583
I20260929 06:40:43.033726 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:40:43.040992 29777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.035173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41712 (local address 127.15.157.190:46181)
0929 06:40:43.035225 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.035227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.035251 (+ 24us) server_negotiation.cc:407] Connection header received
0929 06:40:43.035336 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.035337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.035346 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.035394 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:43.035949 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.036424 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.037151 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.037364 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.037439 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.038592 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:43.038593 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:43.038594 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:43.038601 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:43.039816 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:43.040154 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:43.040156 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:43.040156 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:43.040217 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:43.040420 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:43.040421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:43.040422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:43.040569 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:43.040679 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.040800 (+ 121us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.040880 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:40:43.042443 29718 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:40:43.044062 29718 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:40:43.051103 30189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.046394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:34565 (local address 127.0.0.1:60020)
0929 06:40:43.046549 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.046590 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:43.046655 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:43.047101 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:43.047104 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:43.047107 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:40:43.047181 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.047184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.048577 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.048578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.049994 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.049997 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.050766 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.050767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.050853 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.050868 (+ 15us) client_negotiation.cc:769] Sending connection context
0929 06:40:43.050947 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 06:40:43.051003 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":71,"thread_start_us":52,"threads_started":1}
I20260929 06:40:43.051108 30191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.046489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60020 (local address 127.15.157.129:34565)
0929 06:40:43.046910 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.046916 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.046927 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:40:43.046968 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.046971 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.046989 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.047262 (+ 273us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:40:43.047348 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.048466 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.050096 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.050687 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.050745 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.050781 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.050979 (+ 198us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.051020 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":85,"threads_started":1}
I20260929 06:40:43.051381 30192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.046614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:43181 (local address 127.0.0.1:60712)
0929 06:40:43.046823 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.046832 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:43.046881 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:43.047222 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:43.047222 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:43.047225 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:40:43.047294 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.047295 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.049439 (+ 2144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.049440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.050277 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.050280 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.051148 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.051149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.051209 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.051213 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:40:43.051268 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 06:40:43.051314 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":19,"thread_start_us":69,"threads_started":1}
I20260929 06:40:43.051637 30194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.046805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60712 (local address 127.15.157.131:43181)
0929 06:40:43.047000 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.047004 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.047014 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:40:43.047053 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.047055 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.047071 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.047143 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:40:43.048609 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.049337 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.050392 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.050999 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.051063 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.051114 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.051516 (+ 402us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.051559 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":92,"threads_started":1}
I20260929 06:40:43.052104 29844 tablet_service.cc:1467] Processing CreateTablet for tablet 6b8b89ac4176447c89f0ff36ae6578f4 (DEFAULT_TABLE table=test-table [id=c99b5b72e0c5446a981e1320d624d3a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:40:43.052271 30190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.046431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:40665 (local address 127.0.0.1:46798)
0929 06:40:43.046553 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.046593 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:43.046656 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:43.047221 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:43.047222 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:43.047224 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:40:43.047294 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.047295 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.048578 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.048579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.049995 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.049997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.052009 (+ 2012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.052010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.052071 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.052075 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:40:43.052164 (+ 89us) client_negotiation.cc:240] Negotiation successful
0929 06:40:43.052202 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":47,"thread_start_us":77,"threads_started":1}
I20260929 06:40:43.052278 30193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.046687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46798 (local address 127.15.157.130:40665)
0929 06:40:43.047051 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.047056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.047066 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:40:43.047101 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.047103 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.047117 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.047218 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:40:43.047353 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.048467 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.050813 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.051879 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.051985 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.052035 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.052161 (+ 126us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.052203 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":87,"threads_started":1}
I20260929 06:40:43.052282 30112 tablet_service.cc:1467] Processing CreateTablet for tablet 6b8b89ac4176447c89f0ff36ae6578f4 (DEFAULT_TABLE table=test-table [id=c99b5b72e0c5446a981e1320d624d3a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:40:43.052495 29844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b8b89ac4176447c89f0ff36ae6578f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:43.052639 30112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b8b89ac4176447c89f0ff36ae6578f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:43.055328 30196 tablet_bootstrap.cc:492] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: Bootstrap starting.
I20260929 06:40:43.055191 30195 tablet_bootstrap.cc:492] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5: Bootstrap starting.
I20260929 06:40:43.055974 30196 tablet_bootstrap.cc:654] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:43.055917 29978 tablet_service.cc:1467] Processing CreateTablet for tablet 6b8b89ac4176447c89f0ff36ae6578f4 (DEFAULT_TABLE table=test-table [id=c99b5b72e0c5446a981e1320d624d3a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:40:43.056051 30195 tablet_bootstrap.cc:654] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:43.056236 29978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b8b89ac4176447c89f0ff36ae6578f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:43.056553 30196 log.cc:824] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:43.056631 30195 log.cc:824] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:43.057229 30196 tablet_bootstrap.cc:492] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: No bootstrap required, opened a new log
I20260929 06:40:43.057315 30196 ts_tablet_manager.cc:1397] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:40:43.058519 30195 tablet_bootstrap.cc:492] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5: No bootstrap required, opened a new log
I20260929 06:40:43.058589 30195 ts_tablet_manager.cc:1397] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:40:43.059170 30199 tablet_bootstrap.cc:492] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c: Bootstrap starting.
I20260929 06:40:43.059103 30196 raft_consensus.cc:348] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } }
I20260929 06:40:43.059269 30196 raft_consensus.cc:374] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:43.059312 30196 raft_consensus.cc:729] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69fe84eb7d9246c1ba2f4ccca615b22a, State: Initialized, Role: FOLLOWER
I20260929 06:40:43.059430 30196 consensus_queue.cc:260] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } }
I20260929 06:40:43.059710 30196 ts_tablet_manager.cc:1428] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:40:43.059870 29910 heartbeater.cc:503] Master 127.15.157.190:46181 was elected leader, sending a full tablet report...
I20260929 06:40:43.059787 30199 tablet_bootstrap.cc:654] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:43.060669 30199 log.cc:824] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:43.060737 30195 raft_consensus.cc:348] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } }
I20260929 06:40:43.060909 30195 raft_consensus.cc:374] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:43.060957 30195 raft_consensus.cc:729] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd6a671e9a7a43b48640b45cf4cae2c5, State: Initialized, Role: FOLLOWER
I20260929 06:40:43.061093 30195 consensus_queue.cc:260] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } }
I20260929 06:40:43.061410 30195 ts_tablet_manager.cc:1428] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:40:43.061431 30178 heartbeater.cc:503] Master 127.15.157.190:46181 was elected leader, sending a full tablet report...
I20260929 06:40:43.061447 30199 tablet_bootstrap.cc:492] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c: No bootstrap required, opened a new log
I20260929 06:40:43.061502 30199 ts_tablet_manager.cc:1397] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:40:43.063318 30199 raft_consensus.cc:348] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } }
I20260929 06:40:43.063441 30199 raft_consensus.cc:374] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:43.063460 30199 raft_consensus.cc:729] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958e2f20914b4e14898b44881cd0c40c, State: Initialized, Role: FOLLOWER
I20260929 06:40:43.063560 30199 consensus_queue.cc:260] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } }
I20260929 06:40:43.063786 30199 ts_tablet_manager.cc:1428] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:40:43.063891 30044 heartbeater.cc:503] Master 127.15.157.190:46181 was elected leader, sending a full tablet report...
W20260929 06:40:43.119740 30045 tablet.cc:2369] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:40:43.144392 30200 raft_consensus.cc:482] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:40:43.144515 30200 raft_consensus.cc:504] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } }
I20260929 06:40:43.144946 30200 leader_election.cc:288] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665), cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181)
I20260929 06:40:43.147928 29912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.145169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:40665 (local address 127.15.157.129:41925)
0929 06:40:43.145261 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.145274 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:43.145324 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:43.145478 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:43.145480 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:43.145482 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:40:43.145555 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.145557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.146304 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.146305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.147069 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.147071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.147654 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.147655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.147739 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.147746 (+ 7us) client_negotiation.cc:769] Sending connection context
0929 06:40:43.147810 (+ 64us) client_negotiation.cc:240] Negotiation successful
0929 06:40:43.147853 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260929 06:40:43.147928 30193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.145251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:41925 (local address 127.15.157.130:40665)
0929 06:40:43.145315 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.145317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.145329 (+ 12us) server_negotiation.cc:407] Connection header received
0929 06:40:43.145380 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.145381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.145392 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.145456 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:40:43.145636 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.146221 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.147170 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.147567 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.147657 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.147666 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.147835 (+ 169us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.147869 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 06:40:43.148242 30194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.145469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:55103 (local address 127.15.157.131:43181)
0929 06:40:43.145514 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.145516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.145581 (+ 65us) server_negotiation.cc:407] Connection header received
0929 06:40:43.145652 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.145653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.145662 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.145753 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:40:43.145918 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.146512 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.147502 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.147886 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.147974 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.147982 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.148144 (+ 162us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.148181 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:40:43.148247 29998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b8b89ac4176447c89f0ff36ae6578f4" candidate_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958e2f20914b4e14898b44881cd0c40c" is_pre_election: true
I20260929 06:40:43.148440 29998 raft_consensus.cc:2454] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69fe84eb7d9246c1ba2f4ccca615b22a in term 0.
I20260929 06:40:43.148463 30204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.145359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:43181 (local address 127.15.157.129:55103)
0929 06:40:43.145531 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.145541 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:43.145592 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:43.145763 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:43.145764 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:43.145766 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:40:43.145835 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.145838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.146594 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.146595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.147414 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.147416 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.147975 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.147976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.148048 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.148053 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:40:43.148346 (+ 293us) client_negotiation.cc:240] Negotiation successful
0929 06:40:43.148394 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":108,"threads_started":1}
I20260929 06:40:43.148698 29798 leader_election.cc:302] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69fe84eb7d9246c1ba2f4ccca615b22a, 958e2f20914b4e14898b44881cd0c40c; no voters:
I20260929 06:40:43.148815 30132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b8b89ac4176447c89f0ff36ae6578f4" candidate_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" is_pre_election: true
I20260929 06:40:43.148890 30200 raft_consensus.cc:2781] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:40:43.148976 30200 raft_consensus.cc:482] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:40:43.148973 30132 raft_consensus.cc:2454] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69fe84eb7d9246c1ba2f4ccca615b22a in term 0.
I20260929 06:40:43.149017 30200 raft_consensus.cc:3037] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:40:43.149813 30200 raft_consensus.cc:504] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } }
I20260929 06:40:43.149961 30200 leader_election.cc:288] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 1 election: Requested vote from peers 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665), cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181)
I20260929 06:40:43.150147 29998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b8b89ac4176447c89f0ff36ae6578f4" candidate_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958e2f20914b4e14898b44881cd0c40c"
I20260929 06:40:43.150185 30132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b8b89ac4176447c89f0ff36ae6578f4" candidate_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5"
I20260929 06:40:43.150238 29998 raft_consensus.cc:3037] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:40:43.150249 30132 raft_consensus.cc:3037] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:40:43.151124 30132 raft_consensus.cc:2454] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69fe84eb7d9246c1ba2f4ccca615b22a in term 1.
I20260929 06:40:43.151124 29998 raft_consensus.cc:2454] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69fe84eb7d9246c1ba2f4ccca615b22a in term 1.
I20260929 06:40:43.151333 29798 leader_election.cc:302] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69fe84eb7d9246c1ba2f4ccca615b22a, 958e2f20914b4e14898b44881cd0c40c; no voters:
I20260929 06:40:43.151423 30200 raft_consensus.cc:2781] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:40:43.151571 30200 raft_consensus.cc:686] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 LEADER]: Becoming Leader. State: Replica: 69fe84eb7d9246c1ba2f4ccca615b22a, State: Running, Role: LEADER
I20260929 06:40:43.151667 30200 consensus_queue.cc:237] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } }
I20260929 06:40:43.152518 29719 catalog_manager.cc:5495] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a reported cstate change: term changed from 0 to 1, leader changed from <none> to 69fe84eb7d9246c1ba2f4ccca615b22a (127.15.157.129). New cstate: current_term: 1 leader_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } health_report { overall_health: UNKNOWN } } }
I20260929 06:40:43.166589 30191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.164252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60026 (local address 127.15.157.129:34565)
0929 06:40:43.164309 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.164311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.164319 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:40:43.164394 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.164394 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.164410 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.164470 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:40:43.164581 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.165032 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.165780 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.165961 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.166012 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.166253 (+ 241us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:40:43.166351 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:40:43.166413 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.166452 (+ 39us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.166469 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 06:40:43.168326 30132 raft_consensus.cc:1261] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 1 FOLLOWER]: Refusing update from remote peer 69fe84eb7d9246c1ba2f4ccca615b22a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:40:43.168331 29998 raft_consensus.cc:1261] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c [term 1 FOLLOWER]: Refusing update from remote peer 69fe84eb7d9246c1ba2f4ccca615b22a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:40:43.168697 30200 consensus_queue.cc:1035] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [LEADER]: Connected to new peer: Peer: permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:40:43.168852 30205 consensus_queue.cc:1035] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:40:43.171283 30209 mvcc.cc:205] Tried to move back new op lower bound from 7334559920814899200 to 7334559920749838336. Current Snapshot: MvccSnapshot[applied={T|T < 7334559920814899200}]
I20260929 06:40:43.171537 30208 mvcc.cc:205] Tried to move back new op lower bound from 7334559920814899200 to 7334559920749838336. Current Snapshot: MvccSnapshot[applied={T|T < 7334559920814899200}]
I20260929 06:40:43.173569 29719 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:40:43.173650 29719 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:40:43.174403 29719 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Sending DeleteTablet for 3 replicas of tablet 6b8b89ac4176447c89f0ff36ae6578f4
I20260929 06:40:43.174697 29844 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b8b89ac4176447c89f0ff36ae6578f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:40:43 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:60020
I20260929 06:40:43.174721 29978 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b8b89ac4176447c89f0ff36ae6578f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:40:43 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:46798
I20260929 06:40:43.174739 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 29781
I20260929 06:40:43.174762 30112 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b8b89ac4176447c89f0ff36ae6578f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:40:43 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:60712
I20260929 06:40:43.178651 30219 tablet_replica.cc:330] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5: stopping tablet replica
I20260929 06:40:43.178771 30219 raft_consensus.cc:2229] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:40:43.178870 30219 raft_consensus.cc:2258] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:40:43.178900 30218 tablet_replica.cc:330] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c: stopping tablet replica
I20260929 06:40:43.179132 30218 raft_consensus.cc:2229] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:40:43.179288 30218 raft_consensus.cc:2258] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:40:43.179289 30219 ts_tablet_manager.cc:1905] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:40:43.179726 30218 ts_tablet_manager.cc:1905] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260929 06:40:43.180580 29703 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:34565 (error 108)
I20260929 06:40:43.181066 30190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.180949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:34565 (local address 127.0.0.1:60040)
0929 06:40:43.180998 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.181033 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:34565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260929 06:40:43.181260 29703 catalog_manager.cc:4584] TS 69fe84eb7d9246c1ba2f4ccca615b22a (127.15.157.129:34565): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6b8b89ac4176447c89f0ff36ae6578f4: Network error: Client connection negotiation failed: client connection to 127.15.157.129:34565: connect: Connection refused (error 111)
I20260929 06:40:43.181434 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 29915
I20260929 06:40:43.181540 30219 ts_tablet_manager.cc:1918] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:40:43.181607 30219 log.cc:1196] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/6b8b89ac4176447c89f0ff36ae6578f4
I20260929 06:40:43.181861 30219 ts_tablet_manager.cc:1939] T 6b8b89ac4176447c89f0ff36ae6578f4 P cd6a671e9a7a43b48640b45cf4cae2c5: Deleting consensus metadata
I20260929 06:40:43.182535 29704 catalog_manager.cc:4841] TS cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181): tablet 6b8b89ac4176447c89f0ff36ae6578f4 (table test-table [id=c99b5b72e0c5446a981e1320d624d3a6]) successfully deleted
I20260929 06:40:43.186437 30190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.186315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:40665 (local address 127.0.0.1:46808)
0929 06:40:43.186374 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.186406 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.130:40665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260929 06:40:43.186427 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 30049
I20260929 06:40:43.190884 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 29687
I20260929 06:40:43.196106 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:46181
--webserver_interface=127.15.157.190
--webserver_port=45775
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:46181
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:43.284091 30221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:43.284318 30221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:43.284356 30221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:43.285485 30221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:40:43.285610 30221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:43.285657 30221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:43.285688 30221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:40:43.285717 30221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:40:43.287835 30221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:46181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:46181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=45775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:43.288110 30221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:43.288393 30221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:43.298815 30228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:43.298971 30221 server_base.cc:1034] running on GCE node
W20260929 06:40:43.298835 30230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:43.299062 30227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:43.299399 30221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:43.299805 30221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:43.300978 30221 hybrid_clock.cc:648] HybridClock initialized: now 1790664043300966 us; error 32 us; skew 500 ppm
Sep 29 06:40:43 dist-test-slave-ltw5 krb5kdc[29674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664043, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:43.303817 30221 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:40:43.304550 30221 webserver.cc:460] Webserver started at http://127.15.157.190:45775/ using document root <none> and password file <none>
I20260929 06:40:43.304845 30221 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:43.304932 30221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:43.307070 30221 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:40:43.307835 30237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:43.308028 30221 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:40:43.308122 30221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "14ee6cf173b14724b23b3ba966b305ee"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "cbcbe33fc31594fec6dc8e2a147fea19"
server_key_iv: "c96c647d9383a5f5abfa59c3fef608bf"
server_key_version: "encryptionkey@0"
I20260929 06:40:43.308712 30221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:43.320353 30221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:43.322448 30221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:43.322556 30221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:43.326514 30221 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:46181
I20260929 06:40:43.326568 30289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:46181 every 8 connection(s)
I20260929 06:40:43.326960 30221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:40:43.328532 30290 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:40:43.329434 30290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Bootstrap starting.
I20260929 06:40:43.331032 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 30221
I20260929 06:40:43.331370 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:34565
--local_ip_for_outbound_sockets=127.15.157.129
--tserver_master_addrs=127.15.157.190:46181
--webserver_port=36209
--webserver_interface=127.15.157.129
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:40:43.338809 30290 log.cc:824] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:43.340904 30290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:40:43.341219 30290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Bootstrap complete.
I20260929 06:40:43.343536 30290 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } }
I20260929 06:40:43.343792 30290 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ee6cf173b14724b23b3ba966b305ee, State: Initialized, Role: FOLLOWER
I20260929 06:40:43.343976 30290 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } }
I20260929 06:40:43.344056 30290 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:40:43.344113 30290 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:40:43.344159 30290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 1 FOLLOWER]: Advancing to term 2
I20260929 06:40:43.345446 30290 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } }
I20260929 06:40:43.345573 30290 leader_election.cc:302] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14ee6cf173b14724b23b3ba966b305ee; no voters:
I20260929 06:40:43.345773 30290 leader_election.cc:288] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 06:40:43.345809 30294 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 2 FOLLOWER]: Leader election won for term 2
I20260929 06:40:43.345913 30294 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 2 LEADER]: Becoming Leader. State: Replica: 14ee6cf173b14724b23b3ba966b305ee, State: Running, Role: LEADER
I20260929 06:40:43.346076 30290 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:40:43.346202 30294 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } }
I20260929 06:40:43.346481 30295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "14ee6cf173b14724b23b3ba966b305ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } } }
I20260929 06:40:43.346479 30294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14ee6cf173b14724b23b3ba966b305ee. Latest consensus state: current_term: 2 leader_uuid: "14ee6cf173b14724b23b3ba966b305ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } } }
I20260929 06:40:43.346642 30295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:43.346665 30294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:43.346992 30303 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:40:43.347820 30303 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:40:43.347939 30303 catalog_manager.cc:1259] Loaded cluster ID: 90fb06c9be1b494c906355145098431f
I20260929 06:40:43.347976 30303 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:40:43.348204 30303 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260929 06:40:43.351151 30303 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260929 06:40:43.352933 30303 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:40:43.353134 30303 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Loaded TSK: 0
I20260929 06:40:43.353356 30303 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 06:40:43.428970 30292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:43.429206 30292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:43.429248 30292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:43.430480 30292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:43.430541 30292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:43.430584 30292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:40:43.432055 30292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:34565
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=36209
--tserver_master_addrs=127.15.157.190:46181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:43.432324 30292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:43.432548 30292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:43.438504 30318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:43.438575 30317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:43.438504 30320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:43.438755 30292 server_base.cc:1034] running on GCE node
I20260929 06:40:43.438985 30292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:43.439270 30292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:43.440433 30292 hybrid_clock.cc:648] HybridClock initialized: now 1790664043440421 us; error 32 us; skew 500 ppm
Sep 29 06:40:43 dist-test-slave-ltw5 krb5kdc[29674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664043, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:43.450881 30292 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:40:43.451480 30292 webserver.cc:460] Webserver started at http://127.15.157.129:36209/ using document root <none> and password file <none>
I20260929 06:40:43.451758 30292 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:43.451857 30292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:43.453465 30292 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260929 06:40:43.454245 30327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:43.454453 30292 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:40:43.454569 30292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "69fe84eb7d9246c1ba2f4ccca615b22a"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "4ced4a8130e94683a1cdda8c10a985b4"
server_key_iv: "ad865e13219aa432d0896623bf049747"
server_key_version: "encryptionkey@0"
I20260929 06:40:43.454952 30292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:43.477339 30292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:43.479635 30292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:43.479830 30292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:43.480108 30292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:43.480587 30334 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 06:40:43.482563 30292 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 06:40:43.482632 30292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 06:40:43.482681 30292 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 06:40:43.483371 30292 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 06:40:43.483433 30292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 06:40:43.483493 30334 tablet_bootstrap.cc:492] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: Bootstrap starting.
I20260929 06:40:43.491312 30292 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:34565
I20260929 06:40:43.491463 30441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:34565 every 8 connection(s)
I20260929 06:40:43.491770 30292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:40:43.494375 30334 log.cc:824] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:43.496892 30334 tablet_bootstrap.cc:492] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:40:43.497182 30334 tablet_bootstrap.cc:492] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: Bootstrap complete.
I20260929 06:40:43.497426 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 30292
I20260929 06:40:43.497737 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:40665
--local_ip_for_outbound_sockets=127.15.157.130
--tserver_master_addrs=127.15.157.190:46181
--webserver_port=43747
--webserver_interface=127.15.157.130
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:40:43.498386 30334 ts_tablet_manager.cc:1397] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.006s
Sep 29 06:40:43 dist-test-slave-ltw5 krb5kdc[29674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664043, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:43.500393 30334 raft_consensus.cc:348] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } }
I20260929 06:40:43.500697 30334 raft_consensus.cc:729] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69fe84eb7d9246c1ba2f4ccca615b22a, State: Initialized, Role: FOLLOWER
I20260929 06:40:43.500831 30334 consensus_queue.cc:260] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } }
I20260929 06:40:43.501112 30334 ts_tablet_manager.cc:1428] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260929 06:40:43.504065 30445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.492656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:38079 (local address 127.15.157.190:46181)
0929 06:40:43.492851 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.492862 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.492903 (+ 41us) server_negotiation.cc:407] Connection header received
0929 06:40:43.493567 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.493572 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.493618 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.493776 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:43.494605 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.495789 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.496924 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.497586 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.497720 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.500360 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:43.500364 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:43.500364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:43.500375 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:43.502255 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:43.502777 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:43.502779 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:43.502780 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:43.502866 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:43.503159 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:43.503159 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:43.503160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:43.503387 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:43.503456 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.503814 (+ 358us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.503922 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":88,"threads_started":1}
I20260929 06:40:43.504216 30444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.492566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:38079)
0929 06:40:43.492762 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.492815 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:43.493331 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:43.493804 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:43.493808 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:43.494231 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:43.494432 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.494459 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.495919 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.495920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.496806 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.496808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.497698 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.497699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.498045 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.498677 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:43.498687 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:43.500252 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:43.502335 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:43.502341 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:43.502344 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:43.502680 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:43.502934 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:43.502936 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:43.502936 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:43.503086 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:43.503461 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:43.503468 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:43.503640 (+ 172us) client_negotiation.cc:769] Sending connection context
0929 06:40:43.503777 (+ 137us) client_negotiation.cc:240] Negotiation successful
0929 06:40:43.503971 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":90,"threads_started":1}
I20260929 06:40:43.504985 30442 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46181
I20260929 06:40:43.505090 30442 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:43.505290 30442 heartbeater.cc:511] Master 127.15.157.190:46181 requested a full tablet report, sending...
I20260929 06:40:43.506012 30254 ts_manager.cc:194] Registered new tserver with Master: 69fe84eb7d9246c1ba2f4ccca615b22a (127.15.157.129:34565)
I20260929 06:40:43.507283 30254 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:38079
I20260929 06:40:43.508160 30442 heartbeater.cc:503] Master 127.15.157.190:46181 was elected leader, sending a full tablet report...
Sep 29 06:40:43 dist-test-slave-ltw5 krb5kdc[29674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664043, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for kudu/127.15.157.129@KRBTEST.COM
I20260929 06:40:43.516201 30450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.506769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60042 (local address 127.15.157.129:34565)
0929 06:40:43.506923 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.506927 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.507114 (+ 187us) server_negotiation.cc:407] Connection header received
0929 06:40:43.507187 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.507190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.507206 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.507286 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:43.508370 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.509517 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.510381 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.510866 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.510939 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.513124 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:43.513132 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:43.513132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:43.513139 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:43.514806 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:43.515241 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:43.515254 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:43.515255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:43.515318 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:43.515553 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:43.515554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:43.515555 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:43.515710 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:43.515803 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.516008 (+ 205us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.516104 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":84,"threads_started":1}
I20260929 06:40:43.516207 30449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.506695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:34565 (local address 127.0.0.1:60042)
0929 06:40:43.506991 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.507027 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:43.507106 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:43.507302 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:43.507307 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:43.507650 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:43.507705 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.507708 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.509607 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.509607 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.510305 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.510307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.510953 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.510962 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.511022 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.511505 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:43.511510 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:43.513028 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:43.514911 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:43.514917 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:43.514919 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:43.515129 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:43.515395 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:43.515396 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:43.515396 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:43.515464 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:43.515794 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:43.515800 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:43.515854 (+ 54us) client_negotiation.cc:769] Sending connection context
0929 06:40:43.515955 (+ 101us) client_negotiation.cc:240] Negotiation successful
0929 06:40:43.516087 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":107,"threads_started":1}
I20260929 06:40:43.516606 30376 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b8b89ac4176447c89f0ff36ae6578f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:40:43 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:60042
I20260929 06:40:43.517145 30451 tablet_replica.cc:330] stopping tablet replica
I20260929 06:40:43.517251 30451 raft_consensus.cc:2229] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:40:43.517306 30451 raft_consensus.cc:2258] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:40:43.517603 30451 ts_tablet_manager.cc:1905] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:40:43.520094 30451 ts_tablet_manager.cc:1918] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:40:43.520169 30451 log.cc:1196] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal/wals/6b8b89ac4176447c89f0ff36ae6578f4
I20260929 06:40:43.520390 30451 ts_tablet_manager.cc:1939] T 6b8b89ac4176447c89f0ff36ae6578f4 P 69fe84eb7d9246c1ba2f4ccca615b22a: Deleting consensus metadata
I20260929 06:40:43.520866 30238 catalog_manager.cc:4841] TS 69fe84eb7d9246c1ba2f4ccca615b22a (127.15.157.129:34565): tablet 6b8b89ac4176447c89f0ff36ae6578f4 (table test-table [id=c99b5b72e0c5446a981e1320d624d3a6]) successfully deleted
W20260929 06:40:43.584668 30447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:43.584865 30447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:43.584888 30447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:43.585942 30447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:43.585978 30447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:43.586004 30447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:40:43.587406 30447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:40665
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=43747
--tserver_master_addrs=127.15.157.190:46181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:43.587589 30447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:43.587755 30447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:43.592968 30456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:43.592962 30457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:43.593197 30459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:43.593235 30447 server_base.cc:1034] running on GCE node
I20260929 06:40:43.593490 30447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:43.593736 30447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:43.594903 30447 hybrid_clock.cc:648] HybridClock initialized: now 1790664043594893 us; error 33 us; skew 500 ppm
Sep 29 06:40:43 dist-test-slave-ltw5 krb5kdc[29674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664043, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:43.598230 30447 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:40:43.598662 30447 webserver.cc:460] Webserver started at http://127.15.157.130:43747/ using document root <none> and password file <none>
I20260929 06:40:43.598843 30447 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:43.598894 30447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:43.600126 30447 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:40:43.600767 30466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:43.601037 30447 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:40:43.601125 30447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "958e2f20914b4e14898b44881cd0c40c"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "fb148b4e226936592e1729156b5ff2cb"
server_key_iv: "3cac02eb8d5ab92834451d73b84405b5"
server_key_version: "encryptionkey@0"
I20260929 06:40:43.601444 30447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:43.611588 30447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:43.613749 30447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:43.613889 30447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:43.614149 30447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:43.614559 30473 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260929 06:40:43.615862 30473 ts_tablet_manager.cc:1852] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260929 06:40:43.616120 30473 ts_tablet_manager.cc:1905] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:40:43.618244 30473 ts_tablet_manager.cc:1918] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:40:43.618324 30473 log.cc:1196] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/6b8b89ac4176447c89f0ff36ae6578f4
I20260929 06:40:43.618590 30473 ts_tablet_manager.cc:1939] T 6b8b89ac4176447c89f0ff36ae6578f4 P 958e2f20914b4e14898b44881cd0c40c: Deleting consensus metadata
I20260929 06:40:43.618799 30447 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260929 06:40:43.618867 30447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260929 06:40:43.618912 30447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:40:43.618939 30447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:43.624516 30447 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:40665
I20260929 06:40:43.624625 30580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:40665 every 8 connection(s)
I20260929 06:40:43.624962 30447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:40:43 dist-test-slave-ltw5 krb5kdc[29674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664043, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:43.633265 30445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.625700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:39699 (local address 127.15.157.190:46181)
0929 06:40:43.625747 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.625749 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.625956 (+ 207us) server_negotiation.cc:407] Connection header received
0929 06:40:43.626519 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.626520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.626533 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.626595 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:43.627164 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.627666 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.628622 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.628838 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.628910 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.630934 (+ 2024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:43.630936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:43.630936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:43.630942 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:43.632129 (+ 1187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:43.632506 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:43.632507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:43.632507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:43.632555 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:43.632759 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:43.632759 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:43.632760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:43.632862 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:43.632910 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.633132 (+ 222us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.633199 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:40:43.633499 30583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.625668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:39699)
0929 06:40:43.625836 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.625876 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:43.626425 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:43.626657 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:43.626661 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:43.626907 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:43.627089 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.627093 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.627745 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.627746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.628533 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.628535 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.628914 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.628915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.629008 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.629482 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:43.629490 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:43.630842 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:43.632201 (+ 1359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:43.632207 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:43.632208 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:43.632440 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:43.632610 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:43.632610 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:43.632611 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:43.632703 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:43.632915 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:43.632918 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:43.633027 (+ 109us) client_negotiation.cc:769] Sending connection context
0929 06:40:43.633108 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 06:40:43.633238 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":95,"threads_started":1}
I20260929 06:40:43.634047 30581 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46181
I20260929 06:40:43.634156 30581 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:43.634332 30581 heartbeater.cc:511] Master 127.15.157.190:46181 requested a full tablet report, sending...
I20260929 06:40:43.634495 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 30447
I20260929 06:40:43.634740 30254 ts_manager.cc:194] Registered new tserver with Master: 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665)
I20260929 06:40:43.634776 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:43181
--local_ip_for_outbound_sockets=127.15.157.131
--tserver_master_addrs=127.15.157.190:46181
--webserver_port=46089
--webserver_interface=127.15.157.131
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:40:43.635245 30254 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:39699
W20260929 06:40:43.717171 30584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:43.717374 30584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:43.717397 30584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:43.718631 30584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:43.718672 30584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:43.718729 30584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:40:43.720152 30584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:43181
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=46089
--tserver_master_addrs=127.15.157.190:46181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:43.720387 30584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:43.720630 30584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:43.725452 30589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:43.725483 30592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:43.725483 30590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:43.725569 30584 server_base.cc:1034] running on GCE node
I20260929 06:40:43.725876 30584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:43.726171 30584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:43.727341 30584 hybrid_clock.cc:648] HybridClock initialized: now 1790664043727320 us; error 35 us; skew 500 ppm
Sep 29 06:40:43 dist-test-slave-ltw5 krb5kdc[29674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664043, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:43.729794 30584 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:40:43.730278 30584 webserver.cc:460] Webserver started at http://127.15.157.131:46089/ using document root <none> and password file <none>
I20260929 06:40:43.730468 30584 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:43.730518 30584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:43.731789 30584 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:40:43.732316 30599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:43.732509 30584 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:43.732599 30584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "cd6a671e9a7a43b48640b45cf4cae2c5"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "fa7dabf73560faaf533cea6f759b63e5"
server_key_iv: "dda3a26891ce1132057f070e3e9823d0"
server_key_version: "encryptionkey@0"
I20260929 06:40:43.732949 30584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:43.753073 30584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:43.755487 30584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:43.755653 30584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:43.755895 30584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:43.756199 30584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:40:43.756234 30584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:43.756278 30584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:40:43.756305 30584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:43.762264 30584 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:43181
I20260929 06:40:43.762316 30712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:43181 every 8 connection(s)
I20260929 06:40:43.762639 30584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:40:43 dist-test-slave-ltw5 krb5kdc[29674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664043, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:40:43.769940 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 30584
I20260929 06:40:43.771816 30445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.763388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:60933 (local address 127.15.157.190:46181)
0929 06:40:43.763460 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.763462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.763763 (+ 301us) server_negotiation.cc:407] Connection header received
0929 06:40:43.764225 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.764226 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.764236 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.764285 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:43.765185 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.765662 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.766730 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.766924 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.766981 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.768986 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:43.768987 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:43.768988 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:43.768997 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:43.770328 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:43.770830 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:43.770831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:43.770832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:43.770892 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:43.771153 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:43.771154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:43.771154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:43.771269 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:43.771343 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.771678 (+ 335us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.771752 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 06:40:43.771982 30715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.763422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:60933)
0929 06:40:43.763633 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.763670 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:43.764141 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:43.764346 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:43.764349 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:43.764908 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:43.765104 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.765109 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.765743 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.765743 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.766643 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.766646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.766998 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.766999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.767092 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.767559 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:43.767567 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:43.768875 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:43.770424 (+ 1549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:43.770431 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:43.770433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:43.770741 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:43.770957 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:43.770957 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:43.770958 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:43.771072 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:43.771337 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:43.771343 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:43.771496 (+ 153us) client_negotiation.cc:769] Sending connection context
0929 06:40:43.771613 (+ 117us) client_negotiation.cc:240] Negotiation successful
0929 06:40:43.771765 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":102,"threads_started":1}
I20260929 06:40:43.772516 30713 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46181
I20260929 06:40:43.772629 30713 heartbeater.cc:464] Registering TS with master...
I20260929 06:40:43.772799 30713 heartbeater.cc:511] Master 127.15.157.190:46181 requested a full tablet report, sending...
I20260929 06:40:43.773207 30254 ts_manager.cc:194] Registered new tserver with Master: cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181)
I20260929 06:40:43.773610 30254 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:60933
I20260929 06:40:43.776697 30717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.770373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41716 (local address 127.15.157.190:46181)
0929 06:40:43.770484 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.770485 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.770493 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:40:43.770556 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.770556 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.770567 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.770634 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:43.771369 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.772074 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.773042 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.773318 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.773384 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.774581 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:43.774582 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:43.774582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:43.774588 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:43.775760 (+ 1172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:43.776064 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:43.776064 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:43.776065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:43.776112 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:43.776272 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:43.776273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:43.776273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:43.776362 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:43.776476 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.776522 (+ 46us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.776579 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":66,"threads_started":1}
I20260929 06:40:43.777415 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:40:43.779892 30717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.777725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41724 (local address 127.15.157.190:46181)
0929 06:40:43.777778 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.777780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.777877 (+ 97us) server_negotiation.cc:407] Connection header received
0929 06:40:43.777935 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.777936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.777959 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.778009 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:40:43.778145 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.778567 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.779257 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.779430 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.779479 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.779629 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:40:43.779724 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:40:43.779795 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.779829 (+ 34us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.779848 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 06:40:43.780140 30254 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:41724:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:40:43.781746 30254 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:40:43.783895 30376 tablet_service.cc:1467] Processing CreateTablet for tablet 828bc7a4392a416c81e68035a900a8c8 (DEFAULT_TABLE table=test-table [id=2a68fd4cb9fe4b16abc7b067a699bb6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:40:43.784109 30376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 828bc7a4392a416c81e68035a900a8c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:43.785454 30334 tablet_bootstrap.cc:492] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a: Bootstrap starting.
I20260929 06:40:43.785807 30334 tablet_bootstrap.cc:654] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:43.786365 30334 tablet_bootstrap.cc:492] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a: No bootstrap required, opened a new log
I20260929 06:40:43.786419 30334 ts_tablet_manager.cc:1397] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:40:43.786777 30334 raft_consensus.cc:348] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:43.786859 30334 raft_consensus.cc:374] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:43.786907 30334 raft_consensus.cc:729] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69fe84eb7d9246c1ba2f4ccca615b22a, State: Initialized, Role: FOLLOWER
I20260929 06:40:43.786949 30334 consensus_queue.cc:260] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:43.787029 30334 ts_tablet_manager.cc:1428] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:40:43.789237 30720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.783736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60728 (local address 127.15.157.131:43181)
0929 06:40:43.785640 (+ 1904us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.785646 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.785656 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:40:43.785700 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.785702 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.785719 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.785988 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:40:43.786086 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.787144 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.788366 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.788859 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.788948 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.789005 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.789117 (+ 112us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.789153 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1862,"thread_start_us":107,"threads_started":1}
I20260929 06:40:43.789248 30449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.783653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:43181 (local address 127.0.0.1:60728)
0929 06:40:43.783884 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.783895 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:43.783937 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:43.785858 (+ 1921us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:43.785860 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:43.785861 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:40:43.785908 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.785911 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.787237 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.787238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.788265 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.788267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.788955 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.788956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.789027 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.789045 (+ 18us) client_negotiation.cc:769] Sending connection context
0929 06:40:43.789102 (+ 57us) client_negotiation.cc:240] Negotiation successful
0929 06:40:43.789148 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":19}
I20260929 06:40:43.789271 30721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.785605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46814 (local address 127.15.157.130:40665)
0929 06:40:43.785788 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.785793 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.785803 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:40:43.785844 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.785846 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.785902 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.785986 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:40:43.786115 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.786940 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.788440 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.788928 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.789017 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.789071 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.789153 (+ 82us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.789188 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":123,"threads_started":1}
I20260929 06:40:43.789633 30719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.783747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:40665 (local address 127.0.0.1:46814)
0929 06:40:43.783888 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.783897 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:43.783937 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:43.785982 (+ 2045us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:43.785983 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:43.785985 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:40:43.786059 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.786061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.787057 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.787059 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.788354 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.788357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.789016 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.789017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.789077 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.789081 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:40:43.789140 (+ 59us) client_negotiation.cc:240] Negotiation successful
0929 06:40:43.789181 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":99,"threads_started":1}
I20260929 06:40:43.790143 30515 tablet_service.cc:1467] Processing CreateTablet for tablet 828bc7a4392a416c81e68035a900a8c8 (DEFAULT_TABLE table=test-table [id=2a68fd4cb9fe4b16abc7b067a699bb6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:40:43.790232 30647 tablet_service.cc:1467] Processing CreateTablet for tablet 828bc7a4392a416c81e68035a900a8c8 (DEFAULT_TABLE table=test-table [id=2a68fd4cb9fe4b16abc7b067a699bb6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:40:43.790477 30515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 828bc7a4392a416c81e68035a900a8c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:43.790524 30647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 828bc7a4392a416c81e68035a900a8c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:40:43.792655 30473 tablet_bootstrap.cc:492] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c: Bootstrap starting.
I20260929 06:40:43.793480 30473 tablet_bootstrap.cc:654] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:43.793823 30473 log.cc:824] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:43.794139 30723 tablet_bootstrap.cc:492] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5: Bootstrap starting.
I20260929 06:40:43.794534 30473 tablet_bootstrap.cc:492] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c: No bootstrap required, opened a new log
I20260929 06:40:43.794607 30473 ts_tablet_manager.cc:1397] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:40:43.794713 30723 tablet_bootstrap.cc:654] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5: Neither blocks nor log segments found. Creating new log.
I20260929 06:40:43.795121 30723 log.cc:824] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:43.795955 30723 tablet_bootstrap.cc:492] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5: No bootstrap required, opened a new log
I20260929 06:40:43.796029 30723 ts_tablet_manager.cc:1397] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:40:43.796422 30473 raft_consensus.cc:348] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:43.796572 30473 raft_consensus.cc:374] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:43.796617 30473 raft_consensus.cc:729] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958e2f20914b4e14898b44881cd0c40c, State: Initialized, Role: FOLLOWER
I20260929 06:40:43.796731 30473 consensus_queue.cc:260] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:43.797010 30473 ts_tablet_manager.cc:1428] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:40:43.797045 30581 heartbeater.cc:503] Master 127.15.157.190:46181 was elected leader, sending a full tablet report...
I20260929 06:40:43.797640 30723 raft_consensus.cc:348] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:43.797777 30723 raft_consensus.cc:374] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:40:43.797822 30723 raft_consensus.cc:729] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd6a671e9a7a43b48640b45cf4cae2c5, State: Initialized, Role: FOLLOWER
I20260929 06:40:43.797971 30723 consensus_queue.cc:260] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:43.798252 30723 ts_tablet_manager.cc:1428] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:40:43.798285 30713 heartbeater.cc:503] Master 127.15.157.190:46181 was elected leader, sending a full tablet report...
I20260929 06:40:43.837477 30727 raft_consensus.cc:482] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:40:43.837598 30727 raft_consensus.cc:504] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:43.837942 30727 leader_election.cc:288] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665), 69fe84eb7d9246c1ba2f4ccca615b22a (127.15.157.129:34565)
I20260929 06:40:43.842116 30450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.838252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:52219 (local address 127.15.157.129:34565)
0929 06:40:43.838296 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.838298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.838469 (+ 171us) server_negotiation.cc:407] Connection header received
0929 06:40:43.838520 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.838521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.838543 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.838627 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:40:43.838750 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.839451 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.841013 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.841693 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.841760 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.841847 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.841954 (+ 107us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.842007 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:40:43.842133 30721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.838269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:53859 (local address 127.15.157.130:40665)
0929 06:40:43.838321 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.838323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.838333 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:40:43.838367 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.838367 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.838375 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.838431 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:40:43.838606 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.839396 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.841012 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.841646 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.841735 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.841747 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.841988 (+ 241us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.842060 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:40:43.842134 30728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.838174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:34565 (local address 127.15.157.131:52219)
0929 06:40:43.838376 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.838384 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:43.838452 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:43.838638 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:43.838639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:43.838640 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:40:43.838685 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.838686 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.839542 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.839543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.840895 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.840898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.841793 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.841794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.841877 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.841881 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:40:43.841925 (+ 44us) client_negotiation.cc:240] Negotiation successful
0929 06:40:43.841986 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":103,"thread_start_us":104,"threads_started":1}
I20260929 06:40:43.842144 30715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.838137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:40665 (local address 127.15.157.131:53859)
0929 06:40:43.838224 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.838237 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:43.838280 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:43.838453 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:43.838454 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:43.838456 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:40:43.838538 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.838540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.839537 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.839539 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.840896 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:43.840898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.841785 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.841786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:43.841870 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.841875 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:40:43.841966 (+ 91us) client_negotiation.cc:240] Negotiation successful
0929 06:40:43.842006 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67,"mutex_wait_us":65}
I20260929 06:40:43.842533 30396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "828bc7a4392a416c81e68035a900a8c8" candidate_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" is_pre_election: true
I20260929 06:40:43.842724 30396 raft_consensus.cc:2454] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd6a671e9a7a43b48640b45cf4cae2c5 in term 0.
I20260929 06:40:43.842705 30535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "828bc7a4392a416c81e68035a900a8c8" candidate_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958e2f20914b4e14898b44881cd0c40c" is_pre_election: true
I20260929 06:40:43.842832 30535 raft_consensus.cc:2454] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd6a671e9a7a43b48640b45cf4cae2c5 in term 0.
I20260929 06:40:43.843047 30600 leader_election.cc:302] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69fe84eb7d9246c1ba2f4ccca615b22a, cd6a671e9a7a43b48640b45cf4cae2c5; no voters:
I20260929 06:40:43.843261 30727 raft_consensus.cc:2781] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:40:43.843335 30727 raft_consensus.cc:482] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:40:43.843367 30727 raft_consensus.cc:3037] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:40:43.844080 30727 raft_consensus.cc:504] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:43.844224 30727 leader_election.cc:288] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [CANDIDATE]: Term 1 election: Requested vote from peers 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665), 69fe84eb7d9246c1ba2f4ccca615b22a (127.15.157.129:34565)
I20260929 06:40:43.844374 30396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "828bc7a4392a416c81e68035a900a8c8" candidate_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a"
I20260929 06:40:43.844426 30535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "828bc7a4392a416c81e68035a900a8c8" candidate_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958e2f20914b4e14898b44881cd0c40c"
I20260929 06:40:43.844461 30396 raft_consensus.cc:3037] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:40:43.844529 30535 raft_consensus.cc:3037] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:40:43.845186 30535 raft_consensus.cc:2454] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd6a671e9a7a43b48640b45cf4cae2c5 in term 1.
I20260929 06:40:43.845208 30396 raft_consensus.cc:2454] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd6a671e9a7a43b48640b45cf4cae2c5 in term 1.
I20260929 06:40:43.845362 30600 leader_election.cc:302] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69fe84eb7d9246c1ba2f4ccca615b22a, cd6a671e9a7a43b48640b45cf4cae2c5; no voters:
I20260929 06:40:43.845499 30727 raft_consensus.cc:2781] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:40:43.845700 30727 raft_consensus.cc:686] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 1 LEADER]: Becoming Leader. State: Replica: cd6a671e9a7a43b48640b45cf4cae2c5, State: Running, Role: LEADER
I20260929 06:40:43.845803 30727 consensus_queue.cc:237] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:43.846690 30253 catalog_manager.cc:5495] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131). New cstate: current_term: 1 leader_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260929 06:40:43.861285 30720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.859193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60744 (local address 127.15.157.131:43181)
0929 06:40:43.859235 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:43.859237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:43.859247 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:40:43.859297 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:43.859297 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:43.859314 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:43.859383 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:40:43.859515 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.859973 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.860658 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:43.860853 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:43.860909 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:43.861024 (+ 115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:40:43.861120 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:40:43.861177 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:43.861210 (+ 33us) server_negotiation.cc:299] Negotiation successful
0929 06:40:43.861227 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:40:43.863124 30396 raft_consensus.cc:1261] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Refusing update from remote peer cd6a671e9a7a43b48640b45cf4cae2c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:40:43.863137 30535 raft_consensus.cc:1261] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c [term 1 FOLLOWER]: Refusing update from remote peer cd6a671e9a7a43b48640b45cf4cae2c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:40:43.863489 30727 consensus_queue.cc:1035] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:40:43.863631 30729 consensus_queue.cc:1035] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:40:43.866525 30734 mvcc.cc:205] Tried to move back new op lower bound from 7334559923660795904 to 7334559923593011200. Current Snapshot: MvccSnapshot[applied={T|T < 7334559923660795904 or (T in {7334559923660795904})}]
I20260929 06:40:43.866653 30733 mvcc.cc:205] Tried to move back new op lower bound from 7334559923660795904 to 7334559923593011200. Current Snapshot: MvccSnapshot[applied={T|T < 7334559923660795904}]
I20260929 06:40:43.868067 30254 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:41724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:40:43.868171 30254 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:41724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:40:43.868973 30254 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Sending DeleteTablet for 3 replicas of tablet 828bc7a4392a416c81e68035a900a8c8
I20260929 06:40:43.869323 30647 tablet_service.cc:1514] Processing DeleteTablet for tablet 828bc7a4392a416c81e68035a900a8c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:40:43 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:60728
I20260929 06:40:43.869429 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 30292
I20260929 06:40:43.869426 30515 tablet_service.cc:1514] Processing DeleteTablet for tablet 828bc7a4392a416c81e68035a900a8c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:40:43 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:46814
I20260929 06:40:43.870461 30741 tablet_replica.cc:330] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5: stopping tablet replica
I20260929 06:40:43.870568 30741 raft_consensus.cc:2229] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:40:43.870697 30741 raft_consensus.cc:2258] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:40:43.871145 30741 ts_tablet_manager.cc:1905] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:40:43.872795 30741 ts_tablet_manager.cc:1918] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:40:43.872876 30741 log.cc:1196] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/828bc7a4392a416c81e68035a900a8c8
I20260929 06:40:43.873157 30741 ts_tablet_manager.cc:1939] T 828bc7a4392a416c81e68035a900a8c8 P cd6a671e9a7a43b48640b45cf4cae2c5: Deleting consensus metadata
I20260929 06:40:43.873559 30239 catalog_manager.cc:4841] TS cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181): tablet 828bc7a4392a416c81e68035a900a8c8 (table test-table [id=2a68fd4cb9fe4b16abc7b067a699bb6e]) successfully deleted
I20260929 06:40:43.874157 30742 tablet_replica.cc:330] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c: stopping tablet replica
I20260929 06:40:43.874281 30742 raft_consensus.cc:2229] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:40:43.874401 30742 raft_consensus.cc:2258] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:40:43.874833 30742 ts_tablet_manager.cc:1905] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260929 06:40:43.875801 30238 connection.cc:535] client connection to 127.15.157.129:34565 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260929 06:40:43.875893 30238 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 06:40:43.876362 30742 ts_tablet_manager.cc:1918] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:40:43.876420 30742 log.cc:1196] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/828bc7a4392a416c81e68035a900a8c8
I20260929 06:40:43.876467 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 30447
I20260929 06:40:43.876641 30742 ts_tablet_manager.cc:1939] T 828bc7a4392a416c81e68035a900a8c8 P 958e2f20914b4e14898b44881cd0c40c: Deleting consensus metadata
I20260929 06:40:43.877031 30719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.876452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:34565 (local address 127.0.0.1:60046)
0929 06:40:43.876946 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.876990 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:34565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472}
W20260929 06:40:43.877192 30238 catalog_manager.cc:4584] TS 69fe84eb7d9246c1ba2f4ccca615b22a (127.15.157.129:34565): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 828bc7a4392a416c81e68035a900a8c8: Network error: Client connection negotiation failed: client connection to 127.15.157.129:34565: connect: Connection refused (error 111)
I20260929 06:40:43.881565 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 30584
I20260929 06:40:43.881712 30719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:43.881569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:40665 (local address 127.0.0.1:46828)
0929 06:40:43.881634 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:43.881666 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.130:40665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260929 06:40:43.886890 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 30221
I20260929 06:40:43.891957 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:46181
--webserver_interface=127.15.157.190
--webserver_port=45775
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:46181
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:43.972993 30744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:43.973207 30744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:43.973230 30744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:43.974387 30744 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:40:43.974423 30744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:43.974437 30744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:43.974450 30744 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:40:43.974462 30744 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:40:43.975893 30744 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:46181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:46181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=45775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:43.976078 30744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:43.976251 30744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:43.981231 30752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:43.981245 30749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:43.981418 30744 server_base.cc:1034] running on GCE node
W20260929 06:40:43.981441 30750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:43.981717 30744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:43.982086 30744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:43.983261 30744 hybrid_clock.cc:648] HybridClock initialized: now 1790664043983249 us; error 49 us; skew 500 ppm
Sep 29 06:40:43 dist-test-slave-ltw5 krb5kdc[29674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664043, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:43.985642 30744 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:40:43.986176 30744 webserver.cc:460] Webserver started at http://127.15.157.190:45775/ using document root <none> and password file <none>
I20260929 06:40:43.986423 30744 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:43.986488 30744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:43.987855 30744 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260929 06:40:43.988579 30759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:43.988766 30744 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:40:43.988886 30744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "14ee6cf173b14724b23b3ba966b305ee"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "cbcbe33fc31594fec6dc8e2a147fea19"
server_key_iv: "c96c647d9383a5f5abfa59c3fef608bf"
server_key_version: "encryptionkey@0"
I20260929 06:40:43.989253 30744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:44.010440 30744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:44.012339 30744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:44.012504 30744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:44.016626 30744 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:46181
I20260929 06:40:44.016666 30811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:46181 every 8 connection(s)
I20260929 06:40:44.017073 30744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:40:44.018726 30812 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:40:44.019380 30812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Bootstrap starting.
I20260929 06:40:44.027392 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 30744
I20260929 06:40:44.027738 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:34565
--local_ip_for_outbound_sockets=127.15.157.129
--tserver_master_addrs=127.15.157.190:46181
--webserver_port=36209
--webserver_interface=127.15.157.129
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:40:44.028039 30812 log.cc:824] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:44.030649 30812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:40:44.030965 30812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee: Bootstrap complete.
I20260929 06:40:44.033277 30812 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } }
I20260929 06:40:44.033528 30812 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ee6cf173b14724b23b3ba966b305ee, State: Initialized, Role: FOLLOWER
I20260929 06:40:44.033762 30812 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } }
I20260929 06:40:44.033876 30812 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:40:44.033936 30812 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:40:44.033990 30812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 2 FOLLOWER]: Advancing to term 3
I20260929 06:40:44.035267 30812 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } }
I20260929 06:40:44.035384 30812 leader_election.cc:302] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14ee6cf173b14724b23b3ba966b305ee; no voters:
I20260929 06:40:44.035579 30812 leader_election.cc:288] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [CANDIDATE]: Term 3 election: Requested vote from peers
I20260929 06:40:44.035614 30816 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 3 FOLLOWER]: Leader election won for term 3
I20260929 06:40:44.035732 30816 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [term 3 LEADER]: Becoming Leader. State: Replica: 14ee6cf173b14724b23b3ba966b305ee, State: Running, Role: LEADER
I20260929 06:40:44.035830 30816 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } }
I20260929 06:40:44.035876 30812 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:40:44.036116 30817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14ee6cf173b14724b23b3ba966b305ee. Latest consensus state: current_term: 3 leader_uuid: "14ee6cf173b14724b23b3ba966b305ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } } }
I20260929 06:40:44.036271 30817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:44.036446 30818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "14ee6cf173b14724b23b3ba966b305ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ee6cf173b14724b23b3ba966b305ee" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46181 } } }
I20260929 06:40:44.036520 30818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14ee6cf173b14724b23b3ba966b305ee [sys.catalog]: This master's current role is: LEADER
I20260929 06:40:44.036640 30822 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:40:44.037847 30822 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:40:44.037979 30822 catalog_manager.cc:1259] Loaded cluster ID: 90fb06c9be1b494c906355145098431f
I20260929 06:40:44.038245 30822 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260929 06:40:44.038508 30822 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fe59f0849ad google::LogMessage::Fail() at ??:0
@ 0x7fe59f08788a google::LogMessage::SendToLog() at ??:0
@ 0x7fe59f0844de google::LogMessage::Flush() at ??:0
@ 0x7fe59f085a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fe5a6fa50f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fe5a6fae8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fe5a0f520d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fe5a0f47954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe5a1dab6db start_thread at ??:0
@ 0x7fe59db8261f clone at ??:0
W20260929 06:40:44.124253 30815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:44.124450 30815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:44.124473 30815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:44.125600 30815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:44.125643 30815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:44.125669 30815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:40:44.127360 30815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:34565
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=36209
--tserver_master_addrs=127.15.157.190:46181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:44.127604 30815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:44.127866 30815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:44.132803 30848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:44.132783 30851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:44.132774 30849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:44.133451 30815 server_base.cc:1034] running on GCE node
I20260929 06:40:44.133659 30815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:44.133942 30815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:44.135121 30815 hybrid_clock.cc:648] HybridClock initialized: now 1790664044135104 us; error 34 us; skew 500 ppm
Sep 29 06:40:44 dist-test-slave-ltw5 krb5kdc[29674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664044, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:44.137626 30815 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:40:44.138118 30815 webserver.cc:460] Webserver started at http://127.15.157.129:36209/ using document root <none> and password file <none>
I20260929 06:40:44.138355 30815 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:44.138401 30815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:44.139755 30815 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:40:44.140483 30858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:44.140658 30815 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:40:44.140762 30815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "69fe84eb7d9246c1ba2f4ccca615b22a"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "4ced4a8130e94683a1cdda8c10a985b4"
server_key_iv: "ad865e13219aa432d0896623bf049747"
server_key_version: "encryptionkey@0"
I20260929 06:40:44.141105 30815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:44.149607 30815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:44.151919 30815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:44.152079 30815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:44.152305 30815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:44.152753 30865 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 06:40:44.154867 30815 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 06:40:44.154927 30815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 06:40:44.154974 30815 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 06:40:44.155579 30815 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 06:40:44.155632 30815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 06:40:44.155733 30865 tablet_bootstrap.cc:492] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a: Bootstrap starting.
I20260929 06:40:44.162654 30815 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:34565
I20260929 06:40:44.162801 30972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:34565 every 8 connection(s)
I20260929 06:40:44.163100 30815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:40:44.166604 30865 log.cc:824] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:40:44.169190 30865 tablet_bootstrap.cc:492] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:40:44.169507 30865 tablet_bootstrap.cc:492] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a: Bootstrap complete.
I20260929 06:40:44.170876 30865 ts_tablet_manager.cc:1397] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.010s
I20260929 06:40:44.172477 30865 raft_consensus.cc:348] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:44.172878 30865 raft_consensus.cc:729] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69fe84eb7d9246c1ba2f4ccca615b22a, State: Initialized, Role: FOLLOWER
I20260929 06:40:44.173032 30865 consensus_queue.cc:260] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:44.173269 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 30815
I20260929 06:40:44.173300 30865 ts_tablet_manager.cc:1428] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260929 06:40:44.173544 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:40665
--local_ip_for_outbound_sockets=127.15.157.130
--tserver_master_addrs=127.15.157.190:46181
--webserver_port=43747
--webserver_interface=127.15.157.130
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:44.226557 30975 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:40:44.163792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:49399)
0929 06:40:44.163959 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:44.164000 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:44.164425 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:44.226348 (+ 61923us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":91,"threads_started":1}
W20260929 06:40:44.226846 30973 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:46181 (0 consecutive failures): Network error: Failed to ping master at 127.15.157.190:46181: Client connection negotiation failed: client connection to 127.15.157.190:46181: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 06:40:44.227192 30975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:44.227075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:33545)
0929 06:40:44.227128 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:44.227169 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260929 06:40:44.227535 30975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:44.227458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:59193)
0929 06:40:44.227486 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:44.227512 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260929 06:40:44.227664 30973 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 06:40:44.256175 30978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:44.256377 30978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:44.256400 30978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:44.257488 30978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:44.257524 30978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:44.257550 30978 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:40:44.258978 30978 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:40665
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=43747
--tserver_master_addrs=127.15.157.190:46181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:44.259155 30978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:44.259321 30978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:44.264117 30983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:44.264267 30986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:44.264319 30978 server_base.cc:1034] running on GCE node
W20260929 06:40:44.264132 30984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:44.264917 30978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:44.265203 30978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:44.266347 30978 hybrid_clock.cc:648] HybridClock initialized: now 1790664044266327 us; error 38 us; skew 500 ppm
Sep 29 06:40:44 dist-test-slave-ltw5 krb5kdc[29674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664044, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:44.268870 30978 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:40:44.269307 30978 webserver.cc:460] Webserver started at http://127.15.157.130:43747/ using document root <none> and password file <none>
I20260929 06:40:44.269483 30978 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:44.269522 30978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:44.270809 30978 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:40:44.271350 30993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:44.271521 30978 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:40:44.271623 30978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "958e2f20914b4e14898b44881cd0c40c"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "fb148b4e226936592e1729156b5ff2cb"
server_key_iv: "3cac02eb8d5ab92834451d73b84405b5"
server_key_version: "encryptionkey@0"
I20260929 06:40:44.271970 30978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:44.284559 30978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:44.286962 30978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:44.287125 30978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:44.287367 30978 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:44.287668 30978 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:40:44.287724 30978 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:44.287765 30978 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:40:44.287793 30978 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:44.293690 30978 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:40665
I20260929 06:40:44.293756 31106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:40665 every 8 connection(s)
I20260929 06:40:44.294149 30978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:40:44.295171 31109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:44.294805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:57411)
0929 06:40:44.294954 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:44.295034 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":65,"threads_started":1}
W20260929 06:40:44.295593 31107 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:46181 (0 consecutive failures): Network error: Failed to ping master at 127.15.157.190:46181: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
I20260929 06:40:44.295929 31109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:44.295841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:51621)
0929 06:40:44.295886 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:44.295913 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 06:40:44.296204 31109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:44.296134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:42077)
0929 06:40:44.296172 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:44.296192 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260929 06:40:44.296329 31107 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260929 06:40:44.298446 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 30978
I20260929 06:40:44.298691 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:43181
--local_ip_for_outbound_sockets=127.15.157.131
--tserver_master_addrs=127.15.157.190:46181
--webserver_port=46089
--webserver_interface=127.15.157.131
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:40:44.381525 31110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:40:44.381729 31110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:40:44.381753 31110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:40:44.383049 31110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:40:44.383098 31110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:40:44.383126 31110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:40:44.384598 31110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:43181
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=46089
--tserver_master_addrs=127.15.157.190:46181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:40:44.384848 31110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:40:44.385097 31110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:40:44.390027 31118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:40:44.389990 31116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:44.390206 31110 server_base.cc:1034] running on GCE node
W20260929 06:40:44.389983 31115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:40:44.390460 31110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:40:44.390652 31110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:40:44.391798 31110 hybrid_clock.cc:648] HybridClock initialized: now 1790664044391777 us; error 43 us; skew 500 ppm
Sep 29 06:40:44 dist-test-slave-ltw5 krb5kdc[29674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664044, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:40:44.394308 31110 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:40:44.394675 31110 webserver.cc:460] Webserver started at http://127.15.157.131:46089/ using document root <none> and password file <none>
I20260929 06:40:44.394855 31110 fs_manager.cc:359] Metadata directory not provided
I20260929 06:40:44.394894 31110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:40:44.396138 31110 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:40:44.396693 31125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:44.396893 31110 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:44.396962 31110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "cd6a671e9a7a43b48640b45cf4cae2c5"
format_stamp: "Formatted at 2026-09-29 06:40:42 on dist-test-slave-ltw5"
server_key: "fa7dabf73560faaf533cea6f759b63e5"
server_key_iv: "dda3a26891ce1132057f070e3e9823d0"
server_key_version: "encryptionkey@0"
I20260929 06:40:44.397331 31110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:40:44.409016 31110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:40:44.411294 31110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:40:44.411445 31110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:40:44.411687 31110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:40:44.411995 31110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:40:44.412055 31110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:44.412097 31110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:40:44.412125 31110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:40:44.417827 31110 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:43181
I20260929 06:40:44.417906 31238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:43181 every 8 connection(s)
I20260929 06:40:44.418260 31110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:40:44.419302 31241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:44.418948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:38531)
0929 06:40:44.419094 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:44.419166 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":73,"threads_started":1}
W20260929 06:40:44.419701 31239 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:46181 (0 consecutive failures): Network error: Failed to ping master at 127.15.157.190:46181: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
I20260929 06:40:44.419983 31241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:44.419900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:48311)
0929 06:40:44.419943 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:44.419967 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260929 06:40:44.420224 31241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:44.420178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:48737)
0929 06:40:44.420197 (+ 19us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:44.420213 (+ 16us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260929 06:40:44.420354 31239 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260929 06:40:44.423641 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 31110
I20260929 06:40:45.228291 31243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:45.228034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:39991)
0929 06:40:45.228158 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:45.228223 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":62,"threads_started":1}
I20260929 06:40:45.296828 31244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:45.296639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:43061)
0929 06:40:45.296747 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:45.296776 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":54,"threads_started":1}
I20260929 06:40:45.420918 31245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:45.420704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:45357)
0929 06:40:45.420818 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:45.420857 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":58,"threads_started":1}
I20260929 06:40:45.603848 31246 raft_consensus.cc:482] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:40:45.603981 31246 raft_consensus.cc:504] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:45.604254 31246 leader_election.cc:288] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181), 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665)
Sep 29 06:40:45 dist-test-slave-ltw5 krb5kdc[29674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664044, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.131@KRBTEST.COM
Sep 29 06:40:45 dist-test-slave-ltw5 krb5kdc[29674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664044, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.130@KRBTEST.COM
I20260929 06:40:45.614787 31247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:45.604595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:49937 (local address 127.15.157.131:43181)
0929 06:40:45.604777 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:45.604807 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:45.604848 (+ 41us) server_negotiation.cc:407] Connection header received
0929 06:40:45.605301 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:45.605303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:45.605342 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:45.605483 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:45.606291 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:45.607134 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:45.608102 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:45.608546 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:45.608681 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:45.610950 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:45.610954 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:45.610954 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:45.610966 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:45.612876 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:45.613342 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:45.613345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:45.613345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:45.613451 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:45.613757 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:45.613758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:45.613758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:45.614148 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:45.614218 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:45.614529 (+ 311us) server_negotiation.cc:299] Negotiation successful
0929 06:40:45.614652 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":92,"threads_started":1}
I20260929 06:40:45.614799 31249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:45.604709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:50617 (local address 127.15.157.130:40665)
0929 06:40:45.604850 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0929 06:40:45.604858 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:40:45.604884 (+ 26us) server_negotiation.cc:407] Connection header received
0929 06:40:45.605299 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:40:45.605301 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:40:45.605342 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:40:45.605515 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:40:45.606299 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:45.607143 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:45.608141 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:40:45.608544 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:40:45.608673 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:45.611413 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:40:45.611416 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:40:45.611416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:40:45.611430 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:40:45.613212 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:45.613625 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:45.613628 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:45.613629 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:45.613733 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:40:45.613922 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:40:45.613923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:40:45.613923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:40:45.614213 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:40:45.614307 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0929 06:40:45.614534 (+ 227us) server_negotiation.cc:299] Negotiation successful
0929 06:40:45.614684 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":49,"threads_started":1}
I20260929 06:40:45.614800 31248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:45.604638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:40665 (local address 127.15.157.129:50617)
0929 06:40:45.604756 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:45.604767 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:45.604812 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:45.605541 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:45.605544 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:45.605930 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:45.606151 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:45.606157 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:45.607269 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:45.607270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:45.608019 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:45.608022 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:45.608643 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:45.608644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:45.608759 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:45.609407 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:45.609417 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:45.611310 (+ 1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:45.613316 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:45.613318 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:45.613318 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:45.613549 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:45.613800 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:45.613801 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:45.613801 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:45.613857 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:45.614295 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:45.614296 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:45.614358 (+ 62us) client_negotiation.cc:769] Sending connection context
0929 06:40:45.614464 (+ 106us) client_negotiation.cc:240] Negotiation successful
0929 06:40:45.614655 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":57,"thread_start_us":61,"threads_started":1}
I20260929 06:40:45.615559 31243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:45.604484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:43181 (local address 127.15.157.129:49937)
0929 06:40:45.604539 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:45.604550 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:40:45.604607 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:40:45.605540 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:40:45.605544 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:40:45.605903 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:40:45.606151 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:45.606157 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:45.607236 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:45.607237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:45.608018 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:40:45.608020 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:40:45.608648 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:40:45.608649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:40:45.608759 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:40:45.609356 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:40:45.609364 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:40:45.610842 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:40:45.612960 (+ 2118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:45.612967 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:45.612969 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:45.613259 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:45.613531 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:40:45.613532 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:40:45.613532 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:40:45.613684 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:40:45.614218 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:40:45.614226 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:40:45.614366 (+ 140us) client_negotiation.cc:769] Sending connection context
0929 06:40:45.614464 (+ 98us) client_negotiation.cc:240] Negotiation successful
0929 06:40:45.614736 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":132}
W20260929 06:40:45.615677 30860 leader_election.cc:341] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665): Not found: Tablet not found: 828bc7a4392a416c81e68035a900a8c8
W20260929 06:40:45.616273 30860 leader_election.cc:341] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181): Not found: Tablet not found: 828bc7a4392a416c81e68035a900a8c8
I20260929 06:40:45.616312 30860 leader_election.cc:302] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69fe84eb7d9246c1ba2f4ccca615b22a; no voters: 958e2f20914b4e14898b44881cd0c40c, cd6a671e9a7a43b48640b45cf4cae2c5
I20260929 06:40:45.616441 31246 raft_consensus.cc:2726] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:40:46.229089 31250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:46.228827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:55589)
0929 06:40:46.228971 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:46.229040 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":65,"threads_started":1}
I20260929 06:40:46.297531 31251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:46.297328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:46829)
0929 06:40:46.297455 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:46.297493 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":57,"threads_started":1}
I20260929 06:40:46.421636 31252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:46.421431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:35383)
0929 06:40:46.421558 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:46.421598 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":56,"threads_started":1}
I20260929 06:40:47.229789 31253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:47.229545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:37849)
0929 06:40:47.229696 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:47.229743 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":61,"threads_started":1}
I20260929 06:40:47.298300 31254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:47.298070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:56811)
0929 06:40:47.298223 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:47.298254 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
I20260929 06:40:47.367163 31255 raft_consensus.cc:482] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:40:47.367295 31255 raft_consensus.cc:504] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:47.367522 31255 leader_election.cc:288] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181), 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665)
W20260929 06:40:47.368040 30860 leader_election.cc:341] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665): Not found: Tablet not found: 828bc7a4392a416c81e68035a900a8c8
W20260929 06:40:47.368099 30860 leader_election.cc:341] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181): Not found: Tablet not found: 828bc7a4392a416c81e68035a900a8c8
I20260929 06:40:47.368116 30860 leader_election.cc:302] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69fe84eb7d9246c1ba2f4ccca615b22a; no voters: 958e2f20914b4e14898b44881cd0c40c, cd6a671e9a7a43b48640b45cf4cae2c5
I20260929 06:40:47.368185 31255 raft_consensus.cc:2726] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:40:47.422297 31256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:47.422107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:47253)
0929 06:40:47.422226 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:47.422261 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":55,"threads_started":1}
I20260929 06:40:48.230611 31257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:48.230362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:42875)
0929 06:40:48.230509 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:48.230547 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":62,"threads_started":1}
I20260929 06:40:48.298944 31258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:48.298748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:34427)
0929 06:40:48.298867 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:48.298904 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":57,"threads_started":1}
I20260929 06:40:48.422971 31259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:48.422760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:58257)
0929 06:40:48.422893 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:48.422930 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":60,"threads_started":1}
I20260929 06:40:49.231364 31260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:49.231150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:58299)
0929 06:40:49.231282 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:49.231317 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":60,"threads_started":1}
I20260929 06:40:49.299613 31261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:49.299419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:32913)
0929 06:40:49.299538 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:49.299575 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":56,"threads_started":1}
I20260929 06:40:49.423735 31262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:49.423448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:55965)
0929 06:40:49.423651 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:49.423691 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":63,"threads_started":1}
I20260929 06:40:49.875227 31263 raft_consensus.cc:482] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:40:49.875322 31263 raft_consensus.cc:504] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:49.875515 31263 leader_election.cc:288] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181), 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665)
W20260929 06:40:49.875977 30860 leader_election.cc:341] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181): Not found: Tablet not found: 828bc7a4392a416c81e68035a900a8c8
W20260929 06:40:49.876091 30860 leader_election.cc:341] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665): Not found: Tablet not found: 828bc7a4392a416c81e68035a900a8c8
I20260929 06:40:49.876195 30860 leader_election.cc:302] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69fe84eb7d9246c1ba2f4ccca615b22a; no voters: 958e2f20914b4e14898b44881cd0c40c, cd6a671e9a7a43b48640b45cf4cae2c5
I20260929 06:40:49.876309 31263 raft_consensus.cc:2726] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:40:50.232165 31264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:50.231882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:37365)
0929 06:40:50.232069 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:50.232116 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":89,"threads_started":1}
I20260929 06:40:50.300271 31265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:50.300078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:57363)
0929 06:40:50.300191 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:50.300227 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":56,"threads_started":1}
I20260929 06:40:50.424450 31266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:50.424248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:45987)
0929 06:40:50.424373 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:50.424412 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":63,"threads_started":1}
I20260929 06:40:51.232932 31267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:51.232708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:37935)
0929 06:40:51.232840 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:51.232885 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260929 06:40:51.300885 31268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:51.300687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:47443)
0929 06:40:51.300810 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:51.300844 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":58,"threads_started":1}
I20260929 06:40:51.392896 31269 raft_consensus.cc:482] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:40:51.392985 31269 raft_consensus.cc:504] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:51.393128 31269 leader_election.cc:288] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181), 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665)
W20260929 06:40:51.393512 30860 leader_election.cc:341] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181): Not found: Tablet not found: 828bc7a4392a416c81e68035a900a8c8
W20260929 06:40:51.393636 30860 leader_election.cc:341] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665): Not found: Tablet not found: 828bc7a4392a416c81e68035a900a8c8
I20260929 06:40:51.393672 30860 leader_election.cc:302] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69fe84eb7d9246c1ba2f4ccca615b22a; no voters: 958e2f20914b4e14898b44881cd0c40c, cd6a671e9a7a43b48640b45cf4cae2c5
I20260929 06:40:51.393771 31269 raft_consensus.cc:2726] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:40:51.425168 31270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:51.424940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:53901)
0929 06:40:51.425085 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:51.425121 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
I20260929 06:40:52.233594 31271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:52.233393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:45711)
0929 06:40:52.233513 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:52.233547 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":61,"threads_started":1}
I20260929 06:40:52.301573 31272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:52.301374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:47789)
0929 06:40:52.301505 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:52.301530 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
I20260929 06:40:52.425832 31273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:52.425620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:37999)
0929 06:40:52.425753 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:52.425790 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":73,"threads_started":1}
I20260929 06:40:53.234522 31274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:53.234247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:50655)
0929 06:40:53.234394 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:53.234426 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":82,"threads_started":1}
I20260929 06:40:53.302225 31275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:53.301977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:58337)
0929 06:40:53.302145 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:53.302180 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":109,"threads_started":1}
I20260929 06:40:53.426584 31276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:53.426356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:39357)
0929 06:40:53.426493 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:53.426537 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":62,"threads_started":1}
I20260929 06:40:54.235213 31277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:54.234997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:43035)
0929 06:40:54.235125 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:54.235166 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260929 06:40:54.302892 31278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:54.302671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:32901)
0929 06:40:54.302811 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:54.302846 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":70,"threads_started":1}
I20260929 06:40:54.427314 31279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:54.427117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:60653)
0929 06:40:54.427240 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:54.427270 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
I20260929 06:40:54.859855 31280 raft_consensus.cc:482] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:40:54.859951 31280 raft_consensus.cc:504] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:54.860074 31280 leader_election.cc:288] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181), 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665)
W20260929 06:40:54.860477 30860 leader_election.cc:341] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181): Not found: Tablet not found: 828bc7a4392a416c81e68035a900a8c8
W20260929 06:40:54.860572 30860 leader_election.cc:341] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665): Not found: Tablet not found: 828bc7a4392a416c81e68035a900a8c8
I20260929 06:40:54.860630 30860 leader_election.cc:302] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69fe84eb7d9246c1ba2f4ccca615b22a; no voters: 958e2f20914b4e14898b44881cd0c40c, cd6a671e9a7a43b48640b45cf4cae2c5
I20260929 06:40:54.860720 31280 raft_consensus.cc:2726] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:40:55.235818 31281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:55.235609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:54459)
0929 06:40:55.235734 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:55.235770 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":81,"threads_started":1}
I20260929 06:40:55.303581 31282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:55.303362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:35241)
0929 06:40:55.303505 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:55.303539 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":70,"threads_started":1}
I20260929 06:40:55.427963 31283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:55.427773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:40865)
0929 06:40:55.427890 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:55.427923 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":60,"threads_started":1}
I20260929 06:40:56.236469 31284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:56.236227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:59531)
0929 06:40:56.236378 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:56.236420 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":67,"threads_started":1}
I20260929 06:40:56.304255 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:56.304031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:50935)
0929 06:40:56.304173 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:56.304206 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":72,"threads_started":1}
I20260929 06:40:56.428689 31286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:56.428468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:44081)
0929 06:40:56.428600 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:56.428645 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":57,"threads_started":1}
I20260929 06:40:57.199368 31287 raft_consensus.cc:482] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:40:57.199481 31287 raft_consensus.cc:504] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6a671e9a7a43b48640b45cf4cae2c5" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 43181 } } peers { permanent_uuid: "958e2f20914b4e14898b44881cd0c40c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 40665 } } peers { permanent_uuid: "69fe84eb7d9246c1ba2f4ccca615b22a" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 34565 } }
I20260929 06:40:57.199632 31287 leader_election.cc:288] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181), 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665)
W20260929 06:40:57.200047 30860 leader_election.cc:341] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd6a671e9a7a43b48640b45cf4cae2c5 (127.15.157.131:43181): Not found: Tablet not found: 828bc7a4392a416c81e68035a900a8c8
W20260929 06:40:57.200120 30860 leader_election.cc:341] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 958e2f20914b4e14898b44881cd0c40c (127.15.157.130:40665): Not found: Tablet not found: 828bc7a4392a416c81e68035a900a8c8
I20260929 06:40:57.200137 30860 leader_election.cc:302] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69fe84eb7d9246c1ba2f4ccca615b22a; no voters: 958e2f20914b4e14898b44881cd0c40c, cd6a671e9a7a43b48640b45cf4cae2c5
I20260929 06:40:57.200208 31287 raft_consensus.cc:2726] T 828bc7a4392a416c81e68035a900a8c8 P 69fe84eb7d9246c1ba2f4ccca615b22a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:40:57.237167 31288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:57.236954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:50279)
0929 06:40:57.237086 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:57.237121 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":58,"threads_started":1}
I20260929 06:40:57.305015 31289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:57.304794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:51085)
0929 06:40:57.304919 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:57.304951 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
I20260929 06:40:57.429464 31290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:57.429237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:39737)
0929 06:40:57.429376 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:57.429417 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":59,"threads_started":1}
I20260929 06:40:58.237947 31291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:58.237694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:39473)
0929 06:40:58.237843 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:58.237882 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":62,"threads_started":1}
I20260929 06:40:58.305687 31292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:58.305465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:37825)
0929 06:40:58.305595 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:58.305639 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":58,"threads_started":1}
I20260929 06:40:58.430241 31293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:58.429964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:40037)
0929 06:40:58.430160 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:58.430198 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":140,"threads_started":1}
I20260929 06:40:59.238767 31294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:59.238536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.129:35071)
0929 06:40:59.238687 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:59.238723 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":75,"threads_started":1}
I20260929 06:40:59.306483 31295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:59.306287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.130:40735)
0929 06:40:59.306404 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:59.306437 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":57,"threads_started":1}
I20260929 06:40:59.430541 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 30815
I20260929 06:40:59.431912 31296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:40:59.430785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46181 (local address 127.15.157.131:58759)
0929 06:40:59.431822 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0929 06:40:59.431862 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:46181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1017,"thread_start_us":62,"threads_started":1}
I20260929 06:40:59.435184 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 30978
I20260929 06:40:59.439385 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 31110
2026-09-29T06:40:59Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18213 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:40:59 dist-test-slave-ltw5 krb5kdc[31299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:40:59 dist-test-slave-ltw5 krb5kdc[31299](info): set up 2 sockets
Sep 29 06:40:59 dist-test-slave-ltw5 krb5kdc[31299](info): commencing operation
krb5kdc: starting...
W20260929 06:41:00.483426 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:41:00 dist-test-slave-ltw5 krb5kdc[31299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:41:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:41:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:41:00.602461 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:38727
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:38727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:41:00.683291 31312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:00.683485 31312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:00.683506 31312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:00.684640 31312 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260929 06:41:00.684679 31312 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260929 06:41:00.684693 31312 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260929 06:41:00.684705 31312 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:41:00.684752 31312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:00.684772 31312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:00.684795 31312 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:41:00.684816 31312 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:41:00.686354 31312 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:38727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:38727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:00.686609 31312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:00.686829 31312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:00.692083 31320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:00.692106 31312 server_base.cc:1034] running on GCE node
W20260929 06:41:00.692122 31318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:00.692068 31317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:00.692710 31312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:00.693053 31312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:00.694187 31312 hybrid_clock.cc:648] HybridClock initialized: now 1790664060694174 us; error 28 us; skew 500 ppm
Sep 29 06:41:00 dist-test-slave-ltw5 krb5kdc[31299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664060, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:00.696589 31312 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:41:00.697104 31312 webserver.cc:460] Webserver started at http://127.15.157.190:36519/ using document root <none> and password file <none>
I20260929 06:41:00.697345 31312 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:00.697388 31312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:00.697520 31312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:41:00.698617 31312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "f2058d6db8784637888dcd2fdffeaebd"
format_stamp: "Formatted at 2026-09-29 06:41:00 on dist-test-slave-ltw5"
server_key: "be8171d88b37c503a9d1d377bda72c53"
server_key_iv: "f6c8d444265add898464e68e5e0e86f7"
server_key_version: "encryptionkey@0"
I20260929 06:41:00.698972 31312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "f2058d6db8784637888dcd2fdffeaebd"
format_stamp: "Formatted at 2026-09-29 06:41:00 on dist-test-slave-ltw5"
server_key: "be8171d88b37c503a9d1d377bda72c53"
server_key_iv: "f6c8d444265add898464e68e5e0e86f7"
server_key_version: "encryptionkey@0"
I20260929 06:41:00.700248 31312 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:41:00.700984 31327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:00.701143 31312 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:41:00.701246 31312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "f2058d6db8784637888dcd2fdffeaebd"
format_stamp: "Formatted at 2026-09-29 06:41:00 on dist-test-slave-ltw5"
server_key: "be8171d88b37c503a9d1d377bda72c53"
server_key_iv: "f6c8d444265add898464e68e5e0e86f7"
server_key_version: "encryptionkey@0"
I20260929 06:41:00.701318 31312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:00.716506 31312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:00.718380 31312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:00.718542 31312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:00.722294 31312 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:38727
I20260929 06:41:00.722424 31379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:38727 every 8 connection(s)
I20260929 06:41:00.722776 31312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:41:00.723901 31380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:41:00.726717 31380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Bootstrap starting.
I20260929 06:41:00.727254 31380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Neither blocks nor log segments found. Creating new log.
I20260929 06:41:00.727420 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 31312
I20260929 06:41:00.727553 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:41:00.727596 31380 log.cc:824] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:00.727771 15990 external_mini_cluster.cc:1428] Setting key 94ab5bf2a11def2983fbf95d978d0679
I20260929 06:41:00.728382 31380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: No bootstrap required, opened a new log
I20260929 06:41:00.731106 31380 raft_consensus.cc:348] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } }
I20260929 06:41:00.731283 31380 raft_consensus.cc:374] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:41:00.731320 31380 raft_consensus.cc:729] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2058d6db8784637888dcd2fdffeaebd, State: Initialized, Role: FOLLOWER
I20260929 06:41:00.731437 31380 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } }
I20260929 06:41:00.731505 31380 raft_consensus.cc:388] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:41:00.731534 31380 raft_consensus.cc:482] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:41:00.731580 31380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:41:00.732209 31380 raft_consensus.cc:504] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } }
I20260929 06:41:00.732332 31380 leader_election.cc:302] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2058d6db8784637888dcd2fdffeaebd; no voters:
I20260929 06:41:00.732540 31380 leader_election.cc:288] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:41:00.732594 31385 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:41:00.732772 31385 raft_consensus.cc:686] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 1 LEADER]: Becoming Leader. State: Replica: f2058d6db8784637888dcd2fdffeaebd, State: Running, Role: LEADER
I20260929 06:41:00.732863 31385 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } }
I20260929 06:41:00.733167 31380 sys_catalog.cc:564] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:41:00.733291 31387 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2058d6db8784637888dcd2fdffeaebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } } }
I20260929 06:41:00.733438 31387 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: This master's current role is: LEADER
I20260929 06:41:00.733182 31385 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2058d6db8784637888dcd2fdffeaebd. Latest consensus state: current_term: 1 leader_uuid: "f2058d6db8784637888dcd2fdffeaebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } } }
I20260929 06:41:00.733930 31385 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: This master's current role is: LEADER
I20260929 06:41:00.734074 31389 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:41:00.734550 31389 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 29 06:41:00 dist-test-slave-ltw5 krb5kdc[31299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:41:00.736522 31389 catalog_manager.cc:1347] Generated new cluster ID: d4ba9b6e47f54a9ea646d07d61530a5c
I20260929 06:41:00.736570 31389 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:41:00.738864 31384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:00.728305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43788 (local address 127.15.157.190:38727)
0929 06:41:00.728474 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:00.728481 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:00.728506 (+ 25us) server_negotiation.cc:407] Connection header received
0929 06:41:00.728906 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:00.728912 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:00.728957 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:00.729075 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:00.729864 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:00.730823 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:00.731875 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:00.732296 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:00.732477 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:00.735450 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:00.735454 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:00.735454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:00.735468 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:00.737225 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:00.737606 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:00.737609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:00.737609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:00.737697 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:00.737909 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:00.737910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:00.737910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:00.738237 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:00.738390 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:00.738505 (+ 115us) server_negotiation.cc:299] Negotiation successful
0929 06:41:00.738640 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
I20260929 06:41:00.768721 31389 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:41:00.769294 31389 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:41:00.777040 31389 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Generated new TSK 0
I20260929 06:41:00.777259 31389 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:41:00.812742 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38727
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:41:00.899670 31406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:00.899888 31406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:00.899912 31406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:00.901099 31406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:00.901144 31406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:00.901172 31406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:41:00.902659 31406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:00.902900 31406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:00.903151 31406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:00.908259 31412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:00.908280 31414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:00.908265 31411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:00.908515 31406 server_base.cc:1034] running on GCE node
I20260929 06:41:00.908771 31406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:00.909022 31406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:00.910182 31406 hybrid_clock.cc:648] HybridClock initialized: now 1790664060910187 us; error 47 us; skew 500 ppm
Sep 29 06:41:00 dist-test-slave-ltw5 krb5kdc[31299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664060, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:00.912729 31406 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:41:00.913178 31406 webserver.cc:460] Webserver started at http://127.15.157.129:42449/ using document root <none> and password file <none>
I20260929 06:41:00.913415 31406 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:00.913482 31406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:00.913636 31406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:41:00.914748 31406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef"
format_stamp: "Formatted at 2026-09-29 06:41:00 on dist-test-slave-ltw5"
server_key: "58b57df1239d490307c8d309bcfa9cd2"
server_key_iv: "3ead9a86e39bbadf8843f961a75070da"
server_key_version: "encryptionkey@0"
I20260929 06:41:00.915119 31406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef"
format_stamp: "Formatted at 2026-09-29 06:41:00 on dist-test-slave-ltw5"
server_key: "58b57df1239d490307c8d309bcfa9cd2"
server_key_iv: "3ead9a86e39bbadf8843f961a75070da"
server_key_version: "encryptionkey@0"
I20260929 06:41:00.916460 31406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:41:00.917176 31421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:00.917341 31406 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:41:00.917435 31406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef"
format_stamp: "Formatted at 2026-09-29 06:41:00 on dist-test-slave-ltw5"
server_key: "58b57df1239d490307c8d309bcfa9cd2"
server_key_iv: "3ead9a86e39bbadf8843f961a75070da"
server_key_version: "encryptionkey@0"
I20260929 06:41:00.917513 31406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:00.932227 31406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:00.934684 31406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:00.934847 31406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:00.935129 31406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:41:00.935443 31406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:41:00.935497 31406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:00.935539 31406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:41:00.935575 31406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:00.941316 31406 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:46759
I20260929 06:41:00.941372 31534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:46759 every 8 connection(s)
I20260929 06:41:00.941723 31406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:41:00 dist-test-slave-ltw5 krb5kdc[31299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664060, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:41:00.948268 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 31406
I20260929 06:41:00.948608 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:41:00.948830 15990 external_mini_cluster.cc:1428] Setting key 729f57db09b763292de2f92396d0b6f8
I20260929 06:41:00.951035 31384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:00.942466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:54083 (local address 127.15.157.190:38727)
0929 06:41:00.942532 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:00.942534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:00.942761 (+ 227us) server_negotiation.cc:407] Connection header received
0929 06:41:00.943288 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:00.943290 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:00.943301 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:00.943364 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:00.944295 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:00.944834 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:00.945844 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:00.946124 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:00.946211 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:00.948176 (+ 1965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:00.948177 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:00.948178 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:00.948185 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:00.949633 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:00.950069 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:00.950070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:00.950071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:00.950129 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:00.950384 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:00.950385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:00.950386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:00.950505 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:00.950576 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:00.950855 (+ 279us) server_negotiation.cc:299] Negotiation successful
0929 06:41:00.950938 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 06:41:00.951222 31537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:00.942443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:54083)
0929 06:41:00.942637 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:00.942672 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:00.943180 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:00.943431 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:00.943436 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:00.943998 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:41:00.944189 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:00.944193 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:00.944935 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:00.944936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:00.945746 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:00.945748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:00.946222 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:00.946223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:00.946348 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:00.946790 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:41:00.946798 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:41:00.948080 (+ 1282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:41:00.949738 (+ 1658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:00.949745 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:00.949748 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:00.949967 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:00.950204 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:00.950204 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:00.950205 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:00.950316 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:00.950588 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:41:00.950595 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:41:00.950726 (+ 131us) client_negotiation.cc:769] Sending connection context
0929 06:41:00.950835 (+ 109us) client_negotiation.cc:240] Negotiation successful
0929 06:41:00.950989 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":99,"threads_started":1}
I20260929 06:41:00.951650 31535 heartbeater.cc:347] Connected to a master server at 127.15.157.190:38727
I20260929 06:41:00.951767 31535 heartbeater.cc:464] Registering TS with master...
I20260929 06:41:00.951941 31535 heartbeater.cc:511] Master 127.15.157.190:38727 requested a full tablet report, sending...
I20260929 06:41:00.952556 31344 ts_manager.cc:194] Registered new tserver with Master: 6385f13732ee4c0c80a99d1bd7c0b3ef (127.15.157.129:46759)
I20260929 06:41:00.953218 31344 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:54083
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:41:00.974380 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38727
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:41:01.054677 31540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:01.054932 31540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:01.054971 31540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:01.056095 31540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:01.056172 31540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:01.056214 31540 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:41:01.057655 31540 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:01.057955 31540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:01.058223 31540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:01.063223 31546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:01.063195 31545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:01.063230 31548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:01.063463 31540 server_base.cc:1034] running on GCE node
I20260929 06:41:01.063701 31540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:01.063939 31540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:01.065128 31540 hybrid_clock.cc:648] HybridClock initialized: now 1790664061065122 us; error 37 us; skew 500 ppm
Sep 29 06:41:01 dist-test-slave-ltw5 krb5kdc[31299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664061, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:01.067644 31540 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:41:01.068064 31540 webserver.cc:460] Webserver started at http://127.15.157.130:44309/ using document root <none> and password file <none>
I20260929 06:41:01.068286 31540 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:01.068356 31540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:01.068497 31540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:41:01.069542 31540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "1ad41c2b5aea4135981139fbb505e129"
format_stamp: "Formatted at 2026-09-29 06:41:01 on dist-test-slave-ltw5"
server_key: "218a026abd6316f5a6c1e14db313e177"
server_key_iv: "5fa6eba13ed9be8b7f9a6e48e4f36e0a"
server_key_version: "encryptionkey@0"
I20260929 06:41:01.069914 31540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "1ad41c2b5aea4135981139fbb505e129"
format_stamp: "Formatted at 2026-09-29 06:41:01 on dist-test-slave-ltw5"
server_key: "218a026abd6316f5a6c1e14db313e177"
server_key_iv: "5fa6eba13ed9be8b7f9a6e48e4f36e0a"
server_key_version: "encryptionkey@0"
I20260929 06:41:01.071259 31540 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:41:01.072026 31555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:01.072196 31540 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:41:01.072292 31540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "1ad41c2b5aea4135981139fbb505e129"
format_stamp: "Formatted at 2026-09-29 06:41:01 on dist-test-slave-ltw5"
server_key: "218a026abd6316f5a6c1e14db313e177"
server_key_iv: "5fa6eba13ed9be8b7f9a6e48e4f36e0a"
server_key_version: "encryptionkey@0"
I20260929 06:41:01.072373 31540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:01.102236 31540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:01.104354 31540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:01.104523 31540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:01.104794 31540 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:41:01.105131 31540 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:41:01.105165 31540 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:01.105188 31540 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:41:01.105201 31540 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:01.111325 31540 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:34209
I20260929 06:41:01.111413 31668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:34209 every 8 connection(s)
I20260929 06:41:01.111712 31540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:41:01 dist-test-slave-ltw5 krb5kdc[31299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664061, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:41:01.119274 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 31540
I20260929 06:41:01.119359 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:41:01.119613 15990 external_mini_cluster.cc:1428] Setting key 0ba0284097493cdf8cebcb679939cb5d
I20260929 06:41:01.121031 31384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.112466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:60961 (local address 127.15.157.190:38727)
0929 06:41:01.112547 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:01.112549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:01.112697 (+ 148us) server_negotiation.cc:407] Connection header received
0929 06:41:01.113198 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:01.113199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:01.113210 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:01.113270 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:01.114242 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.114741 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.115683 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.115862 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.115914 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.117898 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:01.117899 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:01.117900 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:01.117906 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:01.119462 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:01.119936 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:01.119937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:01.119937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:01.120044 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:01.120391 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:01.120391 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:01.120392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:01.120495 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:01.120552 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:01.120879 (+ 327us) server_negotiation.cc:299] Negotiation successful
0929 06:41:01.120947 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260929 06:41:01.121390 31671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.112396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:60961)
0929 06:41:01.112569 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:01.112611 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:01.113095 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:01.113332 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:01.113335 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:01.113892 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:41:01.114133 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:01.114138 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.114824 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.114825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:01.115604 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:01.115605 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.115933 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.115934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:01.116029 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.116494 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:41:01.116501 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:41:01.117810 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:41:01.119537 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:01.119544 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:01.119546 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:01.119842 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:01.120145 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:01.120146 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:01.120147 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:01.120321 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:01.120566 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:41:01.120573 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:41:01.120733 (+ 160us) client_negotiation.cc:769] Sending connection context
0929 06:41:01.120851 (+ 118us) client_negotiation.cc:240] Negotiation successful
0929 06:41:01.121026 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":80,"threads_started":1}
I20260929 06:41:01.121886 31669 heartbeater.cc:347] Connected to a master server at 127.15.157.190:38727
I20260929 06:41:01.121982 31669 heartbeater.cc:464] Registering TS with master...
I20260929 06:41:01.122210 31669 heartbeater.cc:511] Master 127.15.157.190:38727 requested a full tablet report, sending...
I20260929 06:41:01.122601 31344 ts_manager.cc:194] Registered new tserver with Master: 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130:34209)
I20260929 06:41:01.123211 31344 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:60961
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:41:01.144773 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38727
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:41:01.224123 31674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:01.224327 31674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:01.224351 31674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:01.225421 31674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:01.225456 31674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:01.225481 31674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:41:01.226864 31674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:01.227056 31674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:01.227226 31674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:01.232260 31680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:01.232267 31682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:01.232297 31674 server_base.cc:1034] running on GCE node
W20260929 06:41:01.232267 31679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:01.232733 31674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:01.232999 31674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:01.234161 31674 hybrid_clock.cc:648] HybridClock initialized: now 1790664061234142 us; error 53 us; skew 500 ppm
Sep 29 06:41:01 dist-test-slave-ltw5 krb5kdc[31299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664061, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:01.236660 31674 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:41:01.237112 31674 webserver.cc:460] Webserver started at http://127.15.157.131:38841/ using document root <none> and password file <none>
I20260929 06:41:01.237344 31674 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:01.237390 31674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:01.237553 31674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:41:01.238657 31674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "eb223996462c4bacb693484beaa53bc1"
format_stamp: "Formatted at 2026-09-29 06:41:01 on dist-test-slave-ltw5"
server_key: "642aab66cf413f7722716b51e997897a"
server_key_iv: "00f51f90bb234ced7a9b6e17dc296704"
server_key_version: "encryptionkey@0"
I20260929 06:41:01.239017 31674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "eb223996462c4bacb693484beaa53bc1"
format_stamp: "Formatted at 2026-09-29 06:41:01 on dist-test-slave-ltw5"
server_key: "642aab66cf413f7722716b51e997897a"
server_key_iv: "00f51f90bb234ced7a9b6e17dc296704"
server_key_version: "encryptionkey@0"
I20260929 06:41:01.240321 31674 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:41:01.241036 31689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:01.241209 31674 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:41:01.241307 31674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "eb223996462c4bacb693484beaa53bc1"
format_stamp: "Formatted at 2026-09-29 06:41:01 on dist-test-slave-ltw5"
server_key: "642aab66cf413f7722716b51e997897a"
server_key_iv: "00f51f90bb234ced7a9b6e17dc296704"
server_key_version: "encryptionkey@0"
I20260929 06:41:01.241385 31674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:01.248087 31674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:01.250099 31674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:01.250247 31674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:01.250460 31674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:41:01.250764 31674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:41:01.250818 31674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:01.250860 31674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:41:01.250886 31674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:01.256857 31674 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:41775
I20260929 06:41:01.256904 31802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:41775 every 8 connection(s)
I20260929 06:41:01.257211 31674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:41:01.259361 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 31674
I20260929 06:41:01.259469 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:41:01.259672 15990 external_mini_cluster.cc:1428] Setting key 4e00814ce56b155d085b417bc3bda350
Sep 29 06:41:01 dist-test-slave-ltw5 krb5kdc[31299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664061, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:41:01.266551 31384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.257849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:57053 (local address 127.15.157.190:38727)
0929 06:41:01.257892 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:01.257895 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:01.258117 (+ 222us) server_negotiation.cc:407] Connection header received
0929 06:41:01.258653 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:01.258654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:01.258668 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:01.258717 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:01.259719 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.260496 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.261459 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.261675 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.261761 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.263920 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:01.263922 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:01.263922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:01.263930 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:01.265161 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:01.265555 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:01.265557 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:01.265557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:01.265620 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:01.265869 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:01.265870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:01.265870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:01.265984 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:01.266115 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:01.266381 (+ 266us) server_negotiation.cc:299] Negotiation successful
0929 06:41:01.266457 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:41:01.266752 31805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.257821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:57053)
0929 06:41:01.257958 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:01.258003 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:01.258540 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:01.258791 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:01.258795 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:01.259361 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:41:01.259619 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:01.259624 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.260569 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.260570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:01.261363 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:01.261365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.261772 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.261773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:01.261904 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.262408 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:41:01.262416 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:41:01.263826 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:41:01.265255 (+ 1429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:01.265260 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:01.265262 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:01.265478 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:01.265689 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:01.265690 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:01.265690 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:01.265795 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:01.266107 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:41:01.266113 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:41:01.266249 (+ 136us) client_negotiation.cc:769] Sending connection context
0929 06:41:01.266359 (+ 110us) client_negotiation.cc:240] Negotiation successful
0929 06:41:01.266524 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":66,"threads_started":1}
I20260929 06:41:01.267244 31803 heartbeater.cc:347] Connected to a master server at 127.15.157.190:38727
I20260929 06:41:01.267340 31803 heartbeater.cc:464] Registering TS with master...
I20260929 06:41:01.267484 31803 heartbeater.cc:511] Master 127.15.157.190:38727 requested a full tablet report, sending...
I20260929 06:41:01.267848 31344 ts_manager.cc:194] Registered new tserver with Master: eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775)
I20260929 06:41:01.268206 31344 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:57053
I20260929 06:41:01.271308 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:41:01.278738 31384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.272648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43802 (local address 127.15.157.190:38727)
0929 06:41:01.272720 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:01.272723 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:01.272820 (+ 97us) server_negotiation.cc:407] Connection header received
0929 06:41:01.272896 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:01.272896 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:01.272906 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:01.272959 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:01.273509 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.273988 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.274782 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.275040 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.275113 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.276260 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:01.276261 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:01.276261 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:01.276268 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:01.277537 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:01.277895 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:01.277896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:01.277896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:01.277949 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:01.278188 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:01.278189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:01.278189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:01.278336 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:01.278441 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:01.278559 (+ 118us) server_negotiation.cc:299] Negotiation successful
0929 06:41:01.278636 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260929 06:41:01.280261 31344 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43802:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:41:01.281862 31344 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:41:01.288285 31818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.284755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51182 (local address 127.15.157.130:34209)
0929 06:41:01.284923 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:01.284929 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:01.284940 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:41:01.284980 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:01.284982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:01.284997 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:01.285092 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:01.285258 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.286094 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.287432 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.287892 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.287983 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.288049 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:01.288159 (+ 110us) server_negotiation.cc:299] Negotiation successful
0929 06:41:01.288197 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":93,"threads_started":1}
I20260929 06:41:01.288272 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.284337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:34209 (local address 127.0.0.1:51182)
0929 06:41:01.284474 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:01.284485 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:01.284530 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:01.285144 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:01.285145 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:01.285147 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:01.285190 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:01.285192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.286224 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.286225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:01.287346 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:01.287349 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.287980 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.287981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:01.288059 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.288072 (+ 13us) client_negotiation.cc:769] Sending connection context
0929 06:41:01.288146 (+ 74us) client_negotiation.cc:240] Negotiation successful
0929 06:41:01.288200 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":5,"thread_start_us":80,"threads_started":1}
I20260929 06:41:01.288436 31815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.284138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44358 (local address 127.15.157.129:46759)
0929 06:41:01.284333 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:01.284338 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:01.284349 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:41:01.284397 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:01.284398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:01.284411 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:01.284537 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:01.284936 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.285766 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.287141 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.287928 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.288005 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.288056 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:01.288310 (+ 254us) server_negotiation.cc:299] Negotiation successful
0929 06:41:01.288352 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":128,"threads_started":1}
I20260929 06:41:01.288687 31814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.284049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:46759 (local address 127.0.0.1:44358)
0929 06:41:01.284169 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:01.284211 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:01.284301 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:01.284565 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:01.284569 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:01.284571 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:01.284644 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:01.284645 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.285869 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.285870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:01.287072 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:01.287075 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.288092 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.288093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:01.288163 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.288166 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:41:01.288214 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 06:41:01.288256 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":75,"threads_started":1}
I20260929 06:41:01.289523 31603 tablet_service.cc:1467] Processing CreateTablet for tablet b72a2f48c42d44aeac9a17925b2494cc (DEFAULT_TABLE table=test-table [id=8117a7e43f2748b993f98173cace6302]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:41:01.289696 31817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.284534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:41775 (local address 127.0.0.1:47396)
0929 06:41:01.284632 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:01.284640 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:01.284680 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:01.286071 (+ 1391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:01.286072 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:01.286074 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:01.286114 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:01.286116 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.287382 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.287383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:01.288553 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:01.288556 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.289447 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.289448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:01.289515 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.289519 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:41:01.289581 (+ 62us) client_negotiation.cc:240] Negotiation successful
0929 06:41:01.289623 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":70,"threads_started":1}
I20260929 06:41:01.289719 31819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.284809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47396 (local address 127.15.157.131:41775)
0929 06:41:01.285905 (+ 1096us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:01.285908 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:01.285916 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:41:01.285945 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:01.285946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:01.285958 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:01.286074 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:01.286182 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.287274 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.288630 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.289365 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.289447 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.289499 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:01.289595 (+ 96us) server_negotiation.cc:299] Negotiation successful
0929 06:41:01.289634 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1067,"thread_start_us":76,"threads_started":1}
I20260929 06:41:01.289888 31603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b72a2f48c42d44aeac9a17925b2494cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:41:01.290369 31737 tablet_service.cc:1467] Processing CreateTablet for tablet b72a2f48c42d44aeac9a17925b2494cc (DEFAULT_TABLE table=test-table [id=8117a7e43f2748b993f98173cace6302]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:41:01.290693 31737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b72a2f48c42d44aeac9a17925b2494cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:41:01.292717 31820 tablet_bootstrap.cc:492] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129: Bootstrap starting.
I20260929 06:41:01.293143 31469 tablet_service.cc:1467] Processing CreateTablet for tablet b72a2f48c42d44aeac9a17925b2494cc (DEFAULT_TABLE table=test-table [id=8117a7e43f2748b993f98173cace6302]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:41:01.293401 31820 tablet_bootstrap.cc:654] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129: Neither blocks nor log segments found. Creating new log.
I20260929 06:41:01.293466 31469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b72a2f48c42d44aeac9a17925b2494cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:41:01.293761 31821 tablet_bootstrap.cc:492] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1: Bootstrap starting.
I20260929 06:41:01.293992 31820 log.cc:824] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:01.294489 31821 tablet_bootstrap.cc:654] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1: Neither blocks nor log segments found. Creating new log.
I20260929 06:41:01.294873 31820 tablet_bootstrap.cc:492] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129: No bootstrap required, opened a new log
I20260929 06:41:01.294952 31820 ts_tablet_manager.cc:1397] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:41:01.295012 31821 log.cc:824] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:01.295807 31821 tablet_bootstrap.cc:492] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1: No bootstrap required, opened a new log
I20260929 06:41:01.295881 31821 ts_tablet_manager.cc:1397] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:41:01.296834 31824 tablet_bootstrap.cc:492] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: Bootstrap starting.
I20260929 06:41:01.297111 31820 raft_consensus.cc:348] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } }
I20260929 06:41:01.297277 31820 raft_consensus.cc:374] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:41:01.297322 31820 raft_consensus.cc:729] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad41c2b5aea4135981139fbb505e129, State: Initialized, Role: FOLLOWER
I20260929 06:41:01.297464 31820 consensus_queue.cc:260] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } }
I20260929 06:41:01.297583 31824 tablet_bootstrap.cc:654] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: Neither blocks nor log segments found. Creating new log.
I20260929 06:41:01.297753 31820 ts_tablet_manager.cc:1428] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 06:41:01.297894 31669 heartbeater.cc:503] Master 127.15.157.190:38727 was elected leader, sending a full tablet report...
I20260929 06:41:01.297770 31821 raft_consensus.cc:348] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } }
I20260929 06:41:01.297963 31821 raft_consensus.cc:374] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:41:01.298007 31821 raft_consensus.cc:729] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb223996462c4bacb693484beaa53bc1, State: Initialized, Role: FOLLOWER
I20260929 06:41:01.298192 31821 consensus_queue.cc:260] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } }
I20260929 06:41:01.298280 31824 log.cc:824] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:01.298499 31821 ts_tablet_manager.cc:1428] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 06:41:01.298511 31803 heartbeater.cc:503] Master 127.15.157.190:38727 was elected leader, sending a full tablet report...
I20260929 06:41:01.299188 31824 tablet_bootstrap.cc:492] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: No bootstrap required, opened a new log
I20260929 06:41:01.299265 31824 ts_tablet_manager.cc:1397] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:41:01.300967 31824 raft_consensus.cc:348] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } }
I20260929 06:41:01.301108 31824 raft_consensus.cc:374] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:41:01.301133 31824 raft_consensus.cc:729] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6385f13732ee4c0c80a99d1bd7c0b3ef, State: Initialized, Role: FOLLOWER
I20260929 06:41:01.301213 31824 consensus_queue.cc:260] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } }
I20260929 06:41:01.301411 31824 ts_tablet_manager.cc:1428] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:41:01.301486 31535 heartbeater.cc:503] Master 127.15.157.190:38727 was elected leader, sending a full tablet report...
I20260929 06:41:01.317776 31825 raft_consensus.cc:482] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:41:01.317931 31825 raft_consensus.cc:504] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } }
I20260929 06:41:01.318408 31825 leader_election.cc:288] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6385f13732ee4c0c80a99d1bd7c0b3ef (127.15.157.129:46759), eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775)
I20260929 06:41:01.322274 31815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.318675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:39353 (local address 127.15.157.129:46759)
0929 06:41:01.318744 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:01.318747 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:01.318758 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:41:01.318806 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:01.318808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:01.318819 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:01.318880 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:01.319086 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.319857 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.321429 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.321850 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.321916 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.321929 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:01.322160 (+ 231us) server_negotiation.cc:299] Negotiation successful
0929 06:41:01.322208 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:41:01.322270 31671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.318595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:46759 (local address 127.15.157.130:39353)
0929 06:41:01.318658 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:01.318673 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:01.318730 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:01.318908 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:01.318910 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:01.318911 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:01.318987 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:01.318988 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.319947 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.319948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:01.321324 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:01.321327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.321928 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.321929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:01.321993 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.321997 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:41:01.322142 (+ 145us) client_negotiation.cc:240] Negotiation successful
0929 06:41:01.322187 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":1}
I20260929 06:41:01.322736 31489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b72a2f48c42d44aeac9a17925b2494cc" candidate_uuid: "1ad41c2b5aea4135981139fbb505e129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" is_pre_election: true
I20260929 06:41:01.322896 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.318736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:41775 (local address 127.15.157.130:33449)
0929 06:41:01.318927 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:01.318940 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:01.319001 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:01.319152 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:01.319152 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:01.319154 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:01.319229 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:01.319230 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.320003 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.320004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:01.321324 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:01.321327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.322626 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.322627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:01.322703 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.322707 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:41:01.322777 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 06:41:01.322818 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":38,"thread_start_us":110,"threads_started":1}
I20260929 06:41:01.322917 31489 raft_consensus.cc:2454] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad41c2b5aea4135981139fbb505e129 in term 0.
I20260929 06:41:01.322995 31819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.318818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:33449 (local address 127.15.157.131:41775)
0929 06:41:01.318880 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:01.318882 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:01.318991 (+ 109us) server_negotiation.cc:407] Connection header received
0929 06:41:01.319073 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:01.319074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:01.319089 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:01.319149 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:01.319326 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.319936 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.321964 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.322532 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.322606 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.322614 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:01.322806 (+ 192us) server_negotiation.cc:299] Negotiation successful
0929 06:41:01.322876 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 06:41:01.323191 31556 leader_election.cc:302] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad41c2b5aea4135981139fbb505e129, 6385f13732ee4c0c80a99d1bd7c0b3ef; no voters:
I20260929 06:41:01.323340 31825 raft_consensus.cc:2781] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:41:01.323408 31825 raft_consensus.cc:482] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:41:01.323436 31825 raft_consensus.cc:3037] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:41:01.323558 31757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b72a2f48c42d44aeac9a17925b2494cc" candidate_uuid: "1ad41c2b5aea4135981139fbb505e129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb223996462c4bacb693484beaa53bc1" is_pre_election: true
I20260929 06:41:01.323731 31757 raft_consensus.cc:2454] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad41c2b5aea4135981139fbb505e129 in term 0.
I20260929 06:41:01.324353 31825 raft_consensus.cc:504] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } }
I20260929 06:41:01.324494 31825 leader_election.cc:288] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [CANDIDATE]: Term 1 election: Requested vote from peers 6385f13732ee4c0c80a99d1bd7c0b3ef (127.15.157.129:46759), eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775)
I20260929 06:41:01.324654 31489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b72a2f48c42d44aeac9a17925b2494cc" candidate_uuid: "1ad41c2b5aea4135981139fbb505e129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef"
I20260929 06:41:01.324743 31489 raft_consensus.cc:3037] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:41:01.325531 31489 raft_consensus.cc:2454] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad41c2b5aea4135981139fbb505e129 in term 1.
I20260929 06:41:01.325680 31757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b72a2f48c42d44aeac9a17925b2494cc" candidate_uuid: "1ad41c2b5aea4135981139fbb505e129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb223996462c4bacb693484beaa53bc1"
I20260929 06:41:01.325695 31556 leader_election.cc:302] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad41c2b5aea4135981139fbb505e129, 6385f13732ee4c0c80a99d1bd7c0b3ef; no voters:
I20260929 06:41:01.325759 31757 raft_consensus.cc:3037] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:41:01.325860 31825 raft_consensus.cc:2781] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:41:01.326093 31825 raft_consensus.cc:686] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [term 1 LEADER]: Becoming Leader. State: Replica: 1ad41c2b5aea4135981139fbb505e129, State: Running, Role: LEADER
I20260929 06:41:01.326198 31825 consensus_queue.cc:237] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } }
I20260929 06:41:01.326764 31757 raft_consensus.cc:2454] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad41c2b5aea4135981139fbb505e129 in term 1.
I20260929 06:41:01.327015 31343 catalog_manager.cc:5495] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130). New cstate: current_term: 1 leader_uuid: "1ad41c2b5aea4135981139fbb505e129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } health_report { overall_health: UNKNOWN } } }
I20260929 06:41:01.333214 31818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.330782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51192 (local address 127.15.157.130:34209)
0929 06:41:01.330826 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:01.330828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:01.330838 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:41:01.330901 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:01.330901 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:01.330928 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:01.331005 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:41:01.331162 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.331621 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.332398 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:01.332594 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:01.332668 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:01.332847 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:41:01.332945 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:41:01.333029 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:01.333073 (+ 44us) server_negotiation.cc:299] Negotiation successful
0929 06:41:01.333091 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:41:01.335057 31489 raft_consensus.cc:1261] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Refusing update from remote peer 1ad41c2b5aea4135981139fbb505e129: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:41:01.335071 31757 raft_consensus.cc:1261] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1 [term 1 FOLLOWER]: Refusing update from remote peer 1ad41c2b5aea4135981139fbb505e129: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:41:01.335443 31825 consensus_queue.cc:1035] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:41:01.335569 31830 consensus_queue.cc:1035] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:41:01.340241 31343 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:41:01.340349 31343 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:41:01.341200 31343 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Sending DeleteTablet for 3 replicas of tablet b72a2f48c42d44aeac9a17925b2494cc
I20260929 06:41:01.341522 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 31406
I20260929 06:41:01.341586 31469 tablet_service.cc:1514] Processing DeleteTablet for tablet b72a2f48c42d44aeac9a17925b2494cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:41:01 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:44358
I20260929 06:41:01.341610 31603 tablet_service.cc:1514] Processing DeleteTablet for tablet b72a2f48c42d44aeac9a17925b2494cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:41:01 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:51182
I20260929 06:41:01.342289 31737 tablet_service.cc:1514] Processing DeleteTablet for tablet b72a2f48c42d44aeac9a17925b2494cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:41:01 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:47396
I20260929 06:41:01.342310 31843 tablet_replica.cc:330] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129: stopping tablet replica
I20260929 06:41:01.342413 31843 raft_consensus.cc:2229] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:41:01.342509 31843 raft_consensus.cc:2258] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:41:01.342973 31843 ts_tablet_manager.cc:1905] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:41:01.344810 31843 ts_tablet_manager.cc:1918] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:41:01.344908 31843 log.cc:1196] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/b72a2f48c42d44aeac9a17925b2494cc
I20260929 06:41:01.345191 31843 ts_tablet_manager.cc:1939] T b72a2f48c42d44aeac9a17925b2494cc P 1ad41c2b5aea4135981139fbb505e129: Deleting consensus metadata
I20260929 06:41:01.345590 31328 catalog_manager.cc:4841] TS 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130:34209): tablet b72a2f48c42d44aeac9a17925b2494cc (table test-table [id=8117a7e43f2748b993f98173cace6302]) successfully deleted
W20260929 06:41:01.347330 31328 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:46759 (error 108)
I20260929 06:41:01.347565 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 31540
I20260929 06:41:01.348199 31844 tablet_replica.cc:330] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1: stopping tablet replica
I20260929 06:41:01.348344 31844 raft_consensus.cc:2229] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:41:01.348417 31817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:01.348280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:46759 (local address 127.0.0.1:44372)
0929 06:41:01.348335 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:01.348374 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:46759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260929 06:41:01.348469 31844 raft_consensus.cc:2258] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260929 06:41:01.348554 31328 catalog_manager.cc:4584] TS 6385f13732ee4c0c80a99d1bd7c0b3ef (127.15.157.129:46759): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b72a2f48c42d44aeac9a17925b2494cc: Network error: Client connection negotiation failed: client connection to 127.15.157.129:46759: connect: Connection refused (error 111)
I20260929 06:41:01.348946 31844 ts_tablet_manager.cc:1905] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:41:01.350407 31844 ts_tablet_manager.cc:1918] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:41:01.350502 31844 log.cc:1196] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/b72a2f48c42d44aeac9a17925b2494cc
I20260929 06:41:01.350767 31844 ts_tablet_manager.cc:1939] T b72a2f48c42d44aeac9a17925b2494cc P eb223996462c4bacb693484beaa53bc1: Deleting consensus metadata
I20260929 06:41:01.351315 31328 catalog_manager.cc:4841] TS eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775): tablet b72a2f48c42d44aeac9a17925b2494cc (table test-table [id=8117a7e43f2748b993f98173cace6302]) successfully deleted
I20260929 06:41:01.354131 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 31674
I20260929 06:41:01.359262 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 31312
I20260929 06:41:21.364979 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:38727
--webserver_interface=127.15.157.190
--webserver_port=36519
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:38727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:41:21.446043 31846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:21.446249 31846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:21.446270 31846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:21.447355 31846 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260929 06:41:21.447389 31846 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260929 06:41:21.447402 31846 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260929 06:41:21.447414 31846 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:41:21.447427 31846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:21.447439 31846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:21.447451 31846 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:41:21.447463 31846 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:41:21.448841 31846 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:38727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:38727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=36519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:21.449033 31846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:21.449210 31846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:21.457762 31853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:21.457757 31855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:21.457800 31852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:21.458062 31846 server_base.cc:1034] running on GCE node
I20260929 06:41:21.458320 31846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:21.458652 31846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:21.459818 31846 hybrid_clock.cc:648] HybridClock initialized: now 1790664081459812 us; error 36 us; skew 500 ppm
Sep 29 06:41:21 dist-test-slave-ltw5 krb5kdc[31299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664081, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:21.468214 31846 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:41:21.468729 31846 webserver.cc:460] Webserver started at http://127.15.157.190:36519/ using document root <none> and password file <none>
I20260929 06:41:21.468981 31846 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:21.469063 31846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:21.470569 31846 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:41:21.471297 31862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:21.471482 31846 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:41:21.471590 31846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "f2058d6db8784637888dcd2fdffeaebd"
format_stamp: "Formatted at 2026-09-29 06:41:00 on dist-test-slave-ltw5"
server_key: "be8171d88b37c503a9d1d377bda72c53"
server_key_iv: "f6c8d444265add898464e68e5e0e86f7"
server_key_version: "encryptionkey@0"
I20260929 06:41:21.472040 31846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:21.488709 31846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:21.490869 31846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:21.491034 31846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:21.495325 31846 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:38727
I20260929 06:41:21.495371 31914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:38727 every 8 connection(s)
I20260929 06:41:21.495776 31846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:41:21.497412 31915 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:41:21.498210 31915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Bootstrap starting.
I20260929 06:41:21.500121 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 31846
I20260929 06:41:21.500394 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:46759
--local_ip_for_outbound_sockets=127.15.157.129
--tserver_master_addrs=127.15.157.190:38727
--webserver_port=42449
--webserver_interface=127.15.157.129
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:41:21.507534 31915 log.cc:824] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:21.509624 31915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:41:21.509977 31915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Bootstrap complete.
I20260929 06:41:21.512504 31915 raft_consensus.cc:348] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } }
I20260929 06:41:21.512775 31915 raft_consensus.cc:729] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2058d6db8784637888dcd2fdffeaebd, State: Initialized, Role: FOLLOWER
I20260929 06:41:21.512986 31915 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } }
I20260929 06:41:21.513082 31915 raft_consensus.cc:388] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:41:21.513144 31915 raft_consensus.cc:482] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:41:21.513204 31915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 1 FOLLOWER]: Advancing to term 2
I20260929 06:41:21.514444 31915 raft_consensus.cc:504] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } }
I20260929 06:41:21.514575 31915 leader_election.cc:302] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2058d6db8784637888dcd2fdffeaebd; no voters:
I20260929 06:41:21.514781 31915 leader_election.cc:288] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 06:41:21.514824 31919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 2 FOLLOWER]: Leader election won for term 2
I20260929 06:41:21.514946 31919 raft_consensus.cc:686] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 2 LEADER]: Becoming Leader. State: Replica: f2058d6db8784637888dcd2fdffeaebd, State: Running, Role: LEADER
I20260929 06:41:21.515041 31919 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } }
I20260929 06:41:21.515077 31915 sys_catalog.cc:564] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:41:21.515300 31919 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2058d6db8784637888dcd2fdffeaebd. Latest consensus state: current_term: 2 leader_uuid: "f2058d6db8784637888dcd2fdffeaebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } } }
I20260929 06:41:21.515395 31919 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: This master's current role is: LEADER
I20260929 06:41:21.515304 31920 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f2058d6db8784637888dcd2fdffeaebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } } }
I20260929 06:41:21.515568 31920 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: This master's current role is: LEADER
I20260929 06:41:21.515590 31923 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:41:21.516496 31923 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:41:21.516619 31923 catalog_manager.cc:1259] Loaded cluster ID: d4ba9b6e47f54a9ea646d07d61530a5c
I20260929 06:41:21.516683 31923 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:41:21.517742 31923 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:41:21.517969 31923 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Loaded TSK: 0
I20260929 06:41:21.534338 31923 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Generated new TSK 1
I20260929 06:41:21.534457 31923 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 06:41:21.599803 31917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:21.600034 31917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:21.600075 31917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:21.601198 31917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:21.601267 31917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:21.601313 31917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:41:21.602795 31917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:46759
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=42449
--tserver_master_addrs=127.15.157.190:38727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:21.603060 31917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:21.603282 31917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:21.609282 31943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:21.609282 31945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:21.609270 31942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:21.609580 31917 server_base.cc:1034] running on GCE node
I20260929 06:41:21.609802 31917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:21.610100 31917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:21.611271 31917 hybrid_clock.cc:648] HybridClock initialized: now 1790664081611246 us; error 43 us; skew 500 ppm
Sep 29 06:41:21 dist-test-slave-ltw5 krb5kdc[31299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664081, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:21.613691 31917 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:41:21.614406 31917 webserver.cc:460] Webserver started at http://127.15.157.129:42449/ using document root <none> and password file <none>
I20260929 06:41:21.614638 31917 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:21.614720 31917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:21.616367 31917 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:41:21.617125 31952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:21.617303 31917 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:41:21.617381 31917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef"
format_stamp: "Formatted at 2026-09-29 06:41:00 on dist-test-slave-ltw5"
server_key: "58b57df1239d490307c8d309bcfa9cd2"
server_key_iv: "3ead9a86e39bbadf8843f961a75070da"
server_key_version: "encryptionkey@0"
I20260929 06:41:21.617740 31917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:21.628268 31917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:21.630447 31917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:21.630602 31917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:21.630857 31917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:41:21.631321 31959 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 06:41:21.632761 31917 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 06:41:21.632814 31917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 06:41:21.632841 31917 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 06:41:21.633497 31917 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 06:41:21.633538 31917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 06:41:21.633579 31959 tablet_bootstrap.cc:492] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: Bootstrap starting.
I20260929 06:41:21.641189 31917 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:46759
I20260929 06:41:21.641366 32066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:46759 every 8 connection(s)
I20260929 06:41:21.641705 31917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:41:21.644790 31959 log.cc:824] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:21.645519 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 31917
I20260929 06:41:21.645813 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:34209
--local_ip_for_outbound_sockets=127.15.157.130
--tserver_master_addrs=127.15.157.190:38727
--webserver_port=44309
--webserver_interface=127.15.157.130
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:41:21.647643 31959 tablet_bootstrap.cc:492] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:41:21.647931 31959 tablet_bootstrap.cc:492] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: Bootstrap complete.
I20260929 06:41:21.649140 31959 ts_tablet_manager.cc:1397] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.009s
I20260929 06:41:21.650795 31959 raft_consensus.cc:348] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } }
I20260929 06:41:21.651196 31959 raft_consensus.cc:729] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6385f13732ee4c0c80a99d1bd7c0b3ef, State: Initialized, Role: FOLLOWER
I20260929 06:41:21.651363 31959 consensus_queue.cc:260] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } }
I20260929 06:41:21.651648 31959 ts_tablet_manager.cc:1428] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
Sep 29 06:41:21 dist-test-slave-ltw5 krb5kdc[31299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664081, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:41:21.657859 32070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.642621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:49513 (local address 127.15.157.190:38727)
0929 06:41:21.645024 (+ 2403us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:21.645033 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:21.645072 (+ 39us) server_negotiation.cc:407] Connection header received
0929 06:41:21.645207 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:21.645214 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:21.645272 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:21.646439 (+ 1167us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:21.646559 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.647915 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.649564 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.650197 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.650306 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.653500 (+ 3194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:21.653505 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:21.653505 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:21.653518 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:21.655774 (+ 2256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:21.656347 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:21.656351 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:21.656351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:21.656476 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:21.656790 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:21.656791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:21.656791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:21.657067 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:21.657146 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:21.657525 (+ 379us) server_negotiation.cc:299] Negotiation successful
0929 06:41:21.657659 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2348,"thread_start_us":87,"threads_started":1}
I20260929 06:41:21.657905 32069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.642464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:49513)
0929 06:41:21.642750 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:21.642795 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:21.643393 (+ 598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:21.645494 (+ 2101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:21.645499 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:21.645864 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:41:21.646175 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.646182 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.648097 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.648098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.649448 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.649450 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.650421 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.650423 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.650577 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.651210 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:41:21.651229 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:41:21.653358 (+ 2129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:41:21.655875 (+ 2517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:21.655882 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:21.655884 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:21.656246 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:21.656559 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:21.656560 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:21.656561 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:21.656709 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:21.657145 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:41:21.657153 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:41:21.657325 (+ 172us) client_negotiation.cc:769] Sending connection context
0929 06:41:21.657457 (+ 132us) client_negotiation.cc:240] Negotiation successful
0929 06:41:21.657648 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":99,"threads_started":1}
I20260929 06:41:21.658733 32067 heartbeater.cc:347] Connected to a master server at 127.15.157.190:38727
I20260929 06:41:21.658821 32067 heartbeater.cc:464] Registering TS with master...
I20260929 06:41:21.658985 32067 heartbeater.cc:511] Master 127.15.157.190:38727 requested a full tablet report, sending...
I20260929 06:41:21.659720 31879 ts_manager.cc:194] Registered new tserver with Master: 6385f13732ee4c0c80a99d1bd7c0b3ef (127.15.157.129:46759)
I20260929 06:41:21.660878 31879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:49513
I20260929 06:41:21.662003 32067 heartbeater.cc:503] Master 127.15.157.190:38727 was elected leader, sending a full tablet report...
I20260929 06:41:21.666415 32074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.660314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:46759 (local address 127.0.0.1:36430)
0929 06:41:21.662119 (+ 1805us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:21.662156 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:21.662253 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:21.662493 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:21.662496 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:21.662498 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:21.662579 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.662580 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.663750 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.663751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.665125 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.665128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.666093 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.666094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.666188 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.666202 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 06:41:21.666285 (+ 83us) client_negotiation.cc:240] Negotiation successful
0929 06:41:21.666338 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1776,"thread_start_us":98,"threads_started":1}
I20260929 06:41:21.666440 32075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.661139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36430 (local address 127.15.157.129:46759)
0929 06:41:21.661291 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:21.661295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:21.662216 (+ 921us) server_negotiation.cc:407] Connection header received
0929 06:41:21.662347 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:21.662350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:21.662365 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:21.662414 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:21.662632 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.663664 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.665233 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.665954 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.666067 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.666122 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:21.666313 (+ 191us) server_negotiation.cc:299] Negotiation successful
0929 06:41:21.666355 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
I20260929 06:41:21.666929 32001 tablet_service.cc:1514] Processing DeleteTablet for tablet b72a2f48c42d44aeac9a17925b2494cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:41:01 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:36430
I20260929 06:41:21.667599 32076 tablet_replica.cc:330] stopping tablet replica
I20260929 06:41:21.667706 32076 raft_consensus.cc:2229] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:41:21.667768 32076 raft_consensus.cc:2258] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:41:21.668090 32076 ts_tablet_manager.cc:1905] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:41:21.670627 32076 ts_tablet_manager.cc:1918] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:41:21.670699 32076 log.cc:1196] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal/wals/b72a2f48c42d44aeac9a17925b2494cc
I20260929 06:41:21.670921 32076 ts_tablet_manager.cc:1939] T b72a2f48c42d44aeac9a17925b2494cc P 6385f13732ee4c0c80a99d1bd7c0b3ef: Deleting consensus metadata
I20260929 06:41:21.671540 31863 catalog_manager.cc:4841] TS 6385f13732ee4c0c80a99d1bd7c0b3ef (127.15.157.129:46759): tablet b72a2f48c42d44aeac9a17925b2494cc (table test-table [id=8117a7e43f2748b993f98173cace6302]) successfully deleted
W20260929 06:41:21.732661 32072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:21.732895 32072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:21.732932 32072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:21.734078 32072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:21.734145 32072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:21.734189 32072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:41:21.735620 32072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:34209
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=44309
--tserver_master_addrs=127.15.157.190:38727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:21.735888 32072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:21.736114 32072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:21.741113 32082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:21.741155 32081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:21.741155 32084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:21.741297 32072 server_base.cc:1034] running on GCE node
I20260929 06:41:21.741511 32072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:21.741780 32072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:21.742929 32072 hybrid_clock.cc:648] HybridClock initialized: now 1790664081742903 us; error 42 us; skew 500 ppm
Sep 29 06:41:21 dist-test-slave-ltw5 krb5kdc[31299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664081, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:21.745307 32072 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:41:21.745764 32072 webserver.cc:460] Webserver started at http://127.15.157.130:44309/ using document root <none> and password file <none>
I20260929 06:41:21.745994 32072 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:21.746107 32072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:21.747419 32072 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:41:21.747977 32091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:21.748142 32072 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:41:21.748238 32072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "1ad41c2b5aea4135981139fbb505e129"
format_stamp: "Formatted at 2026-09-29 06:41:01 on dist-test-slave-ltw5"
server_key: "218a026abd6316f5a6c1e14db313e177"
server_key_iv: "5fa6eba13ed9be8b7f9a6e48e4f36e0a"
server_key_version: "encryptionkey@0"
I20260929 06:41:21.748574 32072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:21.768836 32072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:21.771230 32072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:21.771394 32072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:21.771668 32072 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:41:21.772008 32072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:41:21.772068 32072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:21.772112 32072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:41:21.772140 32072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:21.778548 32072 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:34209
I20260929 06:41:21.778594 32204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:34209 every 8 connection(s)
I20260929 06:41:21.778923 32072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:41:21.782759 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 32072
I20260929 06:41:21.783124 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:41775
--local_ip_for_outbound_sockets=127.15.157.131
--tserver_master_addrs=127.15.157.190:38727
--webserver_port=38841
--webserver_interface=127.15.157.131
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 06:41:21 dist-test-slave-ltw5 krb5kdc[31299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664081, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:41:21.788432 32207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.779605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:38717)
0929 06:41:21.779758 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:21.779794 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:21.780246 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:21.780592 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:21.780596 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:21.781142 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:41:21.781330 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.781334 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.782060 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.782061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.782867 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.782869 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.783413 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.783413 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.783528 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.784015 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:41:21.784022 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:41:21.785338 (+ 1316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:41:21.787177 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:21.787182 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:21.787184 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:21.787383 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:21.787602 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:21.787602 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:21.787603 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:21.787691 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:21.787978 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:41:21.787982 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:41:21.788089 (+ 107us) client_negotiation.cc:769] Sending connection context
0929 06:41:21.788167 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 06:41:21.788277 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
I20260929 06:41:21.788465 32070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.779614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:38717 (local address 127.15.157.190:38727)
0929 06:41:21.779658 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:21.779660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:21.779891 (+ 231us) server_negotiation.cc:407] Connection header received
0929 06:41:21.780413 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:21.780414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:21.780428 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:21.780508 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:21.781434 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.781932 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.782998 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.783323 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.783388 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.785429 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:21.785431 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:21.785431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:21.785440 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:21.787097 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:21.787464 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:21.787465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:21.787465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:21.787531 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:21.787757 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:21.787758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:21.787759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:21.787910 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:21.787988 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:21.788216 (+ 228us) server_negotiation.cc:299] Negotiation successful
0929 06:41:21.788316 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:41:21.788938 32205 heartbeater.cc:347] Connected to a master server at 127.15.157.190:38727
I20260929 06:41:21.789033 32205 heartbeater.cc:464] Registering TS with master...
I20260929 06:41:21.789206 32205 heartbeater.cc:511] Master 127.15.157.190:38727 requested a full tablet report, sending...
I20260929 06:41:21.789573 31879 ts_manager.cc:194] Registered new tserver with Master: 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130:34209)
I20260929 06:41:21.789893 31879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:38717
W20260929 06:41:21.866572 32208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:21.866812 32208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:21.866853 32208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:21.868011 32208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:21.868083 32208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:21.868125 32208 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:41:21.869597 32208 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:41775
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=38841
--tserver_master_addrs=127.15.157.190:38727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:21.869858 32208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:21.870146 32208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:21.875283 32214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:21.875322 32216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:21.875296 32213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:21.875553 32208 server_base.cc:1034] running on GCE node
I20260929 06:41:21.875758 32208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:21.876014 32208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:21.877202 32208 hybrid_clock.cc:648] HybridClock initialized: now 1790664081877182 us; error 42 us; skew 500 ppm
Sep 29 06:41:21 dist-test-slave-ltw5 krb5kdc[31299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664081, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:21.880125 32208 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:41:21.880643 32208 webserver.cc:460] Webserver started at http://127.15.157.131:38841/ using document root <none> and password file <none>
I20260929 06:41:21.880838 32208 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:21.880898 32208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:21.882308 32208 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:41:21.882844 32223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:21.883136 32208 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:41:21.883245 32208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "eb223996462c4bacb693484beaa53bc1"
format_stamp: "Formatted at 2026-09-29 06:41:01 on dist-test-slave-ltw5"
server_key: "642aab66cf413f7722716b51e997897a"
server_key_iv: "00f51f90bb234ced7a9b6e17dc296704"
server_key_version: "encryptionkey@0"
I20260929 06:41:21.883596 32208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:21.893364 32208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:21.895206 32208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:21.895371 32208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:21.895588 32208 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:41:21.895888 32208 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:41:21.895944 32208 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:21.895985 32208 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:41:21.896013 32208 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:21.901831 32208 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:41775
I20260929 06:41:21.901868 32336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:41775 every 8 connection(s)
I20260929 06:41:21.902267 32208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:41:21 dist-test-slave-ltw5 krb5kdc[31299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664081, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:41:21.908470 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 32208
I20260929 06:41:21.911597 32070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.903032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:40643 (local address 127.15.157.190:38727)
0929 06:41:21.903085 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:21.903087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:21.903335 (+ 248us) server_negotiation.cc:407] Connection header received
0929 06:41:21.903791 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:21.903792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:21.903805 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:21.903871 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:21.904766 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.905246 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.906283 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.906489 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.906549 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.908783 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:21.908784 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:21.908784 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:21.908793 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:21.910306 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:21.910717 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:21.910718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:21.910718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:21.910779 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:21.911005 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:21.911006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:21.911006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:21.911130 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:21.911195 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:21.911470 (+ 275us) server_negotiation.cc:299] Negotiation successful
0929 06:41:21.911534 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:41:21.911839 32339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.903044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:40643)
0929 06:41:21.903211 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:21.903246 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:21.903704 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:21.903953 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:21.903956 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:21.904502 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:41:21.904687 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.904691 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.905324 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.905324 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.906209 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.906212 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.906563 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.906563 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.906656 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.907185 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:41:21.907194 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:41:21.908687 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:41:21.910378 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:21.910384 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:21.910386 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:21.910648 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:21.910849 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:21.910849 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:21.910849 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:21.910941 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:21.911190 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:41:21.911194 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:41:21.911316 (+ 122us) client_negotiation.cc:769] Sending connection context
0929 06:41:21.911437 (+ 121us) client_negotiation.cc:240] Negotiation successful
0929 06:41:21.911588 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":88,"threads_started":1}
I20260929 06:41:21.912391 32337 heartbeater.cc:347] Connected to a master server at 127.15.157.190:38727
I20260929 06:41:21.912484 32337 heartbeater.cc:464] Registering TS with master...
I20260929 06:41:21.912678 32337 heartbeater.cc:511] Master 127.15.157.190:38727 requested a full tablet report, sending...
I20260929 06:41:21.913062 31879 ts_manager.cc:194] Registered new tserver with Master: eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775)
I20260929 06:41:21.913535 31879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:40643
I20260929 06:41:21.915864 32341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.908896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50422 (local address 127.15.157.190:38727)
0929 06:41:21.909034 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:21.909036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:21.909112 (+ 76us) server_negotiation.cc:407] Connection header received
0929 06:41:21.909175 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:21.909176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:21.909188 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:21.909244 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:21.909844 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.910410 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.911404 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.911688 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.911762 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.913258 (+ 1496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:21.913260 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:21.913260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:21.913266 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:21.914856 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:21.915221 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:21.915222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:21.915222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:21.915271 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:21.915455 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:21.915456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:21.915456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:21.915543 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:21.915711 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:21.915743 (+ 32us) server_negotiation.cc:299] Negotiation successful
0929 06:41:21.915803 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
I20260929 06:41:21.916572 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:41:21.919113 32341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.916895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50428 (local address 127.15.157.190:38727)
0929 06:41:21.916928 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:21.916930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:21.917047 (+ 117us) server_negotiation.cc:407] Connection header received
0929 06:41:21.917112 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:21.917112 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:21.917138 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:21.917193 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:41:21.917288 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.917715 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.918507 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.918696 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.918757 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.918878 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:41:21.918963 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:41:21.919023 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:21.919053 (+ 30us) server_negotiation.cc:299] Negotiation successful
0929 06:41:21.919070 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:41:21.919385 31879 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:50428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:41:21.921345 31879 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:41:21.923642 32001 tablet_service.cc:1467] Processing CreateTablet for tablet 72d1570b76924e6a94547ec7a00968fd (DEFAULT_TABLE table=test-table [id=d1125d90ad984fb59bb8ac20c41103ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:41:21.923847 32001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d1570b76924e6a94547ec7a00968fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:41:21.925398 31959 tablet_bootstrap.cc:492] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef: Bootstrap starting.
I20260929 06:41:21.925729 31959 tablet_bootstrap.cc:654] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef: Neither blocks nor log segments found. Creating new log.
I20260929 06:41:21.926322 31959 tablet_bootstrap.cc:492] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef: No bootstrap required, opened a new log
I20260929 06:41:21.926375 31959 ts_tablet_manager.cc:1397] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:41:21.926471 31959 raft_consensus.cc:348] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:21.926543 31959 raft_consensus.cc:374] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:41:21.926591 31959 raft_consensus.cc:729] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6385f13732ee4c0c80a99d1bd7c0b3ef, State: Initialized, Role: FOLLOWER
I20260929 06:41:21.926643 31959 consensus_queue.cc:260] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:21.926743 31959 ts_tablet_manager.cc:1428] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 06:41:21.927031 32343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.923257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:34209 (local address 127.0.0.1:60496)
0929 06:41:21.923389 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:21.923399 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:21.923438 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:21.923717 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:21.923718 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:21.923720 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:21.923781 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.923782 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.924856 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.924857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.925748 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.925751 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.926793 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.926794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.926857 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.926861 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:41:21.926915 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 06:41:21.926960 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260929 06:41:21.927299 32345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.923353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60496 (local address 127.15.157.130:34209)
0929 06:41:21.923561 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:21.923566 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:21.923577 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:41:21.923616 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:21.923617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:21.923632 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:21.923717 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:21.923864 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.924758 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.925851 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.926628 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.926699 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.926756 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:21.926952 (+ 196us) server_negotiation.cc:299] Negotiation successful
0929 06:41:21.926992 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":92,"threads_started":1}
I20260929 06:41:21.927613 32074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.923154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:41775 (local address 127.0.0.1:53874)
0929 06:41:21.923223 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:21.923235 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:21.923282 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:21.924082 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:21.924083 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:21.924085 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:21.924118 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.924119 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.925410 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.925411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.926420 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.926423 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.927348 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.927365 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.927437 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.927440 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:41:21.927512 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 06:41:21.927551 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260929 06:41:21.927650 32344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.923245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53874 (local address 127.15.157.131:41775)
0929 06:41:21.923852 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:21.923857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:21.923866 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:41:21.923903 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:21.923905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:21.923931 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:21.924188 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:21.924257 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.925305 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.926510 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.927254 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.927352 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.927412 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:21.927525 (+ 113us) server_negotiation.cc:299] Negotiation successful
0929 06:41:21.927569 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":103,"threads_started":1}
I20260929 06:41:21.927977 32139 tablet_service.cc:1467] Processing CreateTablet for tablet 72d1570b76924e6a94547ec7a00968fd (DEFAULT_TABLE table=test-table [id=d1125d90ad984fb59bb8ac20c41103ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:41:21.928232 32139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d1570b76924e6a94547ec7a00968fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:41:21.928179 32271 tablet_service.cc:1467] Processing CreateTablet for tablet 72d1570b76924e6a94547ec7a00968fd (DEFAULT_TABLE table=test-table [id=d1125d90ad984fb59bb8ac20c41103ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:41:21.928519 32271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d1570b76924e6a94547ec7a00968fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:41:21.930893 32347 tablet_bootstrap.cc:492] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129: Bootstrap starting.
I20260929 06:41:21.931253 32348 tablet_bootstrap.cc:492] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1: Bootstrap starting.
I20260929 06:41:21.931620 32347 tablet_bootstrap.cc:654] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129: Neither blocks nor log segments found. Creating new log.
I20260929 06:41:21.931821 32348 tablet_bootstrap.cc:654] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1: Neither blocks nor log segments found. Creating new log.
I20260929 06:41:21.932166 32347 log.cc:824] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:21.932344 32348 log.cc:824] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:21.932947 32347 tablet_bootstrap.cc:492] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129: No bootstrap required, opened a new log
I20260929 06:41:21.933020 32347 ts_tablet_manager.cc:1397] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:41:21.933048 32348 tablet_bootstrap.cc:492] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1: No bootstrap required, opened a new log
I20260929 06:41:21.933112 32348 ts_tablet_manager.cc:1397] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:41:21.934973 32347 raft_consensus.cc:348] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:21.934973 32348 raft_consensus.cc:348] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:21.935155 32348 raft_consensus.cc:374] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:41:21.935155 32347 raft_consensus.cc:374] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:41:21.935190 32347 raft_consensus.cc:729] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad41c2b5aea4135981139fbb505e129, State: Initialized, Role: FOLLOWER
I20260929 06:41:21.935190 32348 raft_consensus.cc:729] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb223996462c4bacb693484beaa53bc1, State: Initialized, Role: FOLLOWER
I20260929 06:41:21.935307 32347 consensus_queue.cc:260] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:21.935307 32348 consensus_queue.cc:260] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:21.935576 32348 ts_tablet_manager.cc:1428] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:41:21.935576 32347 ts_tablet_manager.cc:1428] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:41:21.935590 32205 heartbeater.cc:503] Master 127.15.157.190:38727 was elected leader, sending a full tablet report...
I20260929 06:41:21.935714 32337 heartbeater.cc:503] Master 127.15.157.190:38727 was elected leader, sending a full tablet report...
I20260929 06:41:21.952116 32073 raft_consensus.cc:482] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:41:21.952306 32073 raft_consensus.cc:504] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:21.952699 32073 leader_election.cc:288] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775), 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130:34209)
I20260929 06:41:21.957224 32344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.952950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:53339 (local address 127.15.157.131:41775)
0929 06:41:21.953030 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:21.953033 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:21.953046 (+ 13us) server_negotiation.cc:407] Connection header received
0929 06:41:21.953083 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:21.953084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:21.953095 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:21.953163 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:21.953699 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.954453 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.956222 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.956809 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.956896 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.956906 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:21.957112 (+ 206us) server_negotiation.cc:299] Negotiation successful
0929 06:41:21.957154 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260929 06:41:21.957224 32345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.953251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:33529 (local address 127.15.157.130:34209)
0929 06:41:21.953318 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:21.953321 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:21.953328 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:41:21.953349 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:21.953350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:21.953357 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:21.953405 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:21.953612 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.954453 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.956232 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.956840 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.956905 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.956915 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:21.957114 (+ 199us) server_negotiation.cc:299] Negotiation successful
0929 06:41:21.957154 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 06:41:21.957244 32069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.952862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:41775 (local address 127.15.157.129:53339)
0929 06:41:21.952944 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:21.952959 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:21.953022 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:21.953188 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:21.953189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:21.953190 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:21.953609 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.953610 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.954582 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.954584 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.956108 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.956112 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.956934 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.956935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.957023 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.957030 (+ 7us) client_negotiation.cc:769] Sending connection context
0929 06:41:21.957093 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 06:41:21.957139 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":98}
I20260929 06:41:21.957270 32353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.953009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:34209 (local address 127.15.157.129:33529)
0929 06:41:21.953218 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:21.953228 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:21.953279 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:21.953427 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:21.953428 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:21.953430 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:21.953508 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.953510 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.954582 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.954584 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.956108 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:21.956112 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.956958 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.956958 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:21.957023 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.957031 (+ 8us) client_negotiation.cc:769] Sending connection context
0929 06:41:21.957093 (+ 62us) client_negotiation.cc:240] Negotiation successful
0929 06:41:21.957139 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":75,"thread_start_us":135,"threads_started":1}
I20260929 06:41:21.957594 32159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d1570b76924e6a94547ec7a00968fd" candidate_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad41c2b5aea4135981139fbb505e129" is_pre_election: true
I20260929 06:41:21.957659 32291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d1570b76924e6a94547ec7a00968fd" candidate_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb223996462c4bacb693484beaa53bc1" is_pre_election: true
I20260929 06:41:21.957759 32159 raft_consensus.cc:2454] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6385f13732ee4c0c80a99d1bd7c0b3ef in term 0.
I20260929 06:41:21.957858 32291 raft_consensus.cc:2454] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6385f13732ee4c0c80a99d1bd7c0b3ef in term 0.
I20260929 06:41:21.957998 31953 leader_election.cc:302] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad41c2b5aea4135981139fbb505e129, 6385f13732ee4c0c80a99d1bd7c0b3ef; no voters:
I20260929 06:41:21.958190 32073 raft_consensus.cc:2781] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:41:21.958268 32073 raft_consensus.cc:482] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:41:21.958287 32073 raft_consensus.cc:3037] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:41:21.959098 32073 raft_consensus.cc:504] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:21.959239 32073 leader_election.cc:288] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 1 election: Requested vote from peers eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775), 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130:34209)
I20260929 06:41:21.959444 32159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d1570b76924e6a94547ec7a00968fd" candidate_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad41c2b5aea4135981139fbb505e129"
I20260929 06:41:21.959440 32291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d1570b76924e6a94547ec7a00968fd" candidate_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb223996462c4bacb693484beaa53bc1"
I20260929 06:41:21.959527 32159 raft_consensus.cc:3037] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:41:21.959527 32291 raft_consensus.cc:3037] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:41:21.960435 32291 raft_consensus.cc:2454] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6385f13732ee4c0c80a99d1bd7c0b3ef in term 1.
I20260929 06:41:21.960426 32159 raft_consensus.cc:2454] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6385f13732ee4c0c80a99d1bd7c0b3ef in term 1.
I20260929 06:41:21.960596 31953 leader_election.cc:302] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6385f13732ee4c0c80a99d1bd7c0b3ef, eb223996462c4bacb693484beaa53bc1; no voters:
I20260929 06:41:21.960695 32073 raft_consensus.cc:2781] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:41:21.960845 32073 raft_consensus.cc:686] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 LEADER]: Becoming Leader. State: Replica: 6385f13732ee4c0c80a99d1bd7c0b3ef, State: Running, Role: LEADER
I20260929 06:41:21.960906 32073 consensus_queue.cc:237] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:21.961689 31879 catalog_manager.cc:5495] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 6385f13732ee4c0c80a99d1bd7c0b3ef (127.15.157.129). New cstate: current_term: 1 leader_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } health_report { overall_health: HEALTHY } } }
I20260929 06:41:21.972571 32075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.970481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36432 (local address 127.15.157.129:46759)
0929 06:41:21.970527 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:21.970529 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:21.970538 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:41:21.970605 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:21.970606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:21.970620 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:21.970671 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:41:21.970745 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.971219 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.971966 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:21.972153 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:21.972203 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:21.972322 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:41:21.972411 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:41:21.972462 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:21.972504 (+ 42us) server_negotiation.cc:299] Negotiation successful
0929 06:41:21.972521 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 06:41:21.973934 32291 raft_consensus.cc:1261] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1 [term 1 FOLLOWER]: Refusing update from remote peer 6385f13732ee4c0c80a99d1bd7c0b3ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:41:21.973954 32159 raft_consensus.cc:1261] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129 [term 1 FOLLOWER]: Refusing update from remote peer 6385f13732ee4c0c80a99d1bd7c0b3ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:41:21.974292 32073 consensus_queue.cc:1035] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:41:21.974542 32354 consensus_queue.cc:1035] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:41:21.977522 32357 mvcc.cc:205] Tried to move back new op lower bound from 7334560079762997248 to 7334560079712522240. Current Snapshot: MvccSnapshot[applied={T|T < 7334560079762997248 or (T in {7334560079762997248})}]
I20260929 06:41:21.977731 32359 mvcc.cc:205] Tried to move back new op lower bound from 7334560079762997248 to 7334560079712522240. Current Snapshot: MvccSnapshot[applied={T|T < 7334560079762997248 or (T in {7334560079762997248})}]
I20260929 06:41:21.977831 32358 mvcc.cc:205] Tried to move back new op lower bound from 7334560079762997248 to 7334560079712522240. Current Snapshot: MvccSnapshot[applied={T|T < 7334560079762997248 or (T in {7334560079762997248})}]
I20260929 06:41:21.978940 31879 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:50428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:41:21.979027 31879 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:50428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:41:21.979727 31879 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Sending DeleteTablet for 3 replicas of tablet 72d1570b76924e6a94547ec7a00968fd
I20260929 06:41:21.980046 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 31917
I20260929 06:41:21.980086 32271 tablet_service.cc:1514] Processing DeleteTablet for tablet 72d1570b76924e6a94547ec7a00968fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:41:21 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:53874
I20260929 06:41:21.980134 32139 tablet_service.cc:1514] Processing DeleteTablet for tablet 72d1570b76924e6a94547ec7a00968fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:41:21 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:60496
I20260929 06:41:21.980937 32368 tablet_replica.cc:330] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129: stopping tablet replica
I20260929 06:41:21.981058 32368 raft_consensus.cc:2229] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:41:21.981156 32368 raft_consensus.cc:2258] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:41:21.981297 32367 tablet_replica.cc:330] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1: stopping tablet replica
I20260929 06:41:21.981396 32367 raft_consensus.cc:2229] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:41:21.981488 32367 raft_consensus.cc:2258] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:41:21.981600 32368 ts_tablet_manager.cc:1905] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:41:21.981843 32367 ts_tablet_manager.cc:1905] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:41:21.983490 32367 ts_tablet_manager.cc:1918] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:41:21.983542 32368 ts_tablet_manager.cc:1918] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:41:21.983573 32367 log.cc:1196] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/72d1570b76924e6a94547ec7a00968fd
I20260929 06:41:21.983609 32368 log.cc:1196] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/72d1570b76924e6a94547ec7a00968fd
I20260929 06:41:21.983850 32367 ts_tablet_manager.cc:1939] T 72d1570b76924e6a94547ec7a00968fd P eb223996462c4bacb693484beaa53bc1: Deleting consensus metadata
I20260929 06:41:21.983875 32368 ts_tablet_manager.cc:1939] T 72d1570b76924e6a94547ec7a00968fd P 1ad41c2b5aea4135981139fbb505e129: Deleting consensus metadata
I20260929 06:41:21.984236 31863 catalog_manager.cc:4841] TS 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130:34209): tablet 72d1570b76924e6a94547ec7a00968fd (table test-table [id=d1125d90ad984fb59bb8ac20c41103ea]) successfully deleted
I20260929 06:41:21.984315 31863 catalog_manager.cc:4841] TS eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775): tablet 72d1570b76924e6a94547ec7a00968fd (table test-table [id=d1125d90ad984fb59bb8ac20c41103ea]) successfully deleted
W20260929 06:41:21.986174 31863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:46759 (error 108)
I20260929 06:41:21.986570 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 32072
I20260929 06:41:21.986672 32074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:21.986534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:46759 (local address 127.0.0.1:36436)
0929 06:41:21.986592 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:21.986638 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:46759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260929 06:41:21.987244 31863 catalog_manager.cc:4584] TS 6385f13732ee4c0c80a99d1bd7c0b3ef (127.15.157.129:46759): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 72d1570b76924e6a94547ec7a00968fd: Network error: Client connection negotiation failed: client connection to 127.15.157.129:46759: connect: Connection refused (error 111)
I20260929 06:41:21.991225 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 32208
I20260929 06:41:21.995675 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 31846
I20260929 06:41:42.001202 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:38727
--webserver_interface=127.15.157.190
--webserver_port=36519
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:38727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:41:42.081103 32370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:42.081307 32370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:42.081329 32370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:42.082546 32370 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260929 06:41:42.082590 32370 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260929 06:41:42.082603 32370 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260929 06:41:42.082615 32370 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:41:42.082628 32370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:42.082670 32370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:42.082701 32370 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:41:42.082718 32370 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:41:42.084233 32370 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:38727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:38727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=36519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32370
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:42.084501 32370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:42.084726 32370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:42.090070 32378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:42.090108 32370 server_base.cc:1034] running on GCE node
W20260929 06:41:42.090242 32376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:42.090322 32375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:42.090574 32370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:42.090884 32370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:42.092080 32370 hybrid_clock.cc:648] HybridClock initialized: now 1790664102092066 us; error 41 us; skew 500 ppm
Sep 29 06:41:42 dist-test-slave-ltw5 krb5kdc[31299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664102, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:42.103662 32370 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:41:42.104126 32370 webserver.cc:460] Webserver started at http://127.15.157.190:36519/ using document root <none> and password file <none>
I20260929 06:41:42.104379 32370 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:42.104429 32370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:42.105863 32370 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:41:42.106680 32385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:42.106900 32370 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:41:42.107014 32370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "f2058d6db8784637888dcd2fdffeaebd"
format_stamp: "Formatted at 2026-09-29 06:41:00 on dist-test-slave-ltw5"
server_key: "be8171d88b37c503a9d1d377bda72c53"
server_key_iv: "f6c8d444265add898464e68e5e0e86f7"
server_key_version: "encryptionkey@0"
I20260929 06:41:42.107391 32370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:42.125701 32370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:42.127655 32370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:42.127811 32370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:42.132048 32370 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:38727
I20260929 06:41:42.132105 32437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:38727 every 8 connection(s)
I20260929 06:41:42.132464 32370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:41:42.133903 32438 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:41:42.134593 32438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Bootstrap starting.
I20260929 06:41:42.136461 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 32370
I20260929 06:41:42.136766 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:46759
--local_ip_for_outbound_sockets=127.15.157.129
--tserver_master_addrs=127.15.157.190:38727
--webserver_port=42449
--webserver_interface=127.15.157.129
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:41:42.143185 32438 log.cc:824] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:42.145406 32438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:41:42.145716 32438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Bootstrap complete.
I20260929 06:41:42.147954 32438 raft_consensus.cc:348] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } }
I20260929 06:41:42.148203 32438 raft_consensus.cc:729] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2058d6db8784637888dcd2fdffeaebd, State: Initialized, Role: FOLLOWER
I20260929 06:41:42.148411 32438 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } }
I20260929 06:41:42.148502 32438 raft_consensus.cc:388] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:41:42.148555 32438 raft_consensus.cc:482] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:41:42.148603 32438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 2 FOLLOWER]: Advancing to term 3
I20260929 06:41:42.149570 32438 raft_consensus.cc:504] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } }
I20260929 06:41:42.149685 32438 leader_election.cc:302] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2058d6db8784637888dcd2fdffeaebd; no voters:
I20260929 06:41:42.149873 32438 leader_election.cc:288] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [CANDIDATE]: Term 3 election: Requested vote from peers
I20260929 06:41:42.149921 32442 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 3 FOLLOWER]: Leader election won for term 3
I20260929 06:41:42.150131 32442 raft_consensus.cc:686] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [term 3 LEADER]: Becoming Leader. State: Replica: f2058d6db8784637888dcd2fdffeaebd, State: Running, Role: LEADER
I20260929 06:41:42.150166 32438 sys_catalog.cc:564] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:41:42.150224 32442 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } }
I20260929 06:41:42.150489 32443 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "f2058d6db8784637888dcd2fdffeaebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } } }
I20260929 06:41:42.150584 32443 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: This master's current role is: LEADER
I20260929 06:41:42.150746 32444 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2058d6db8784637888dcd2fdffeaebd. Latest consensus state: current_term: 3 leader_uuid: "f2058d6db8784637888dcd2fdffeaebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2058d6db8784637888dcd2fdffeaebd" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38727 } } }
I20260929 06:41:42.150821 32444 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd [sys.catalog]: This master's current role is: LEADER
I20260929 06:41:42.150944 32448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:41:42.151759 32448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:41:42.151859 32448 catalog_manager.cc:1259] Loaded cluster ID: d4ba9b6e47f54a9ea646d07d61530a5c
I20260929 06:41:42.152086 32448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:41:42.153339 32448 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:41:42.153518 32448 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Loaded TSK: 0
I20260929 06:41:42.153561 32448 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f2058d6db8784637888dcd2fdffeaebd: Loaded TSK: 1
F20260929 06:41:42.153842 32448 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f3d6090c9ad google::LogMessage::Fail() at ??:0
@ 0x7f3d6090f88a google::LogMessage::SendToLog() at ??:0
@ 0x7f3d6090c4de google::LogMessage::Flush() at ??:0
@ 0x7f3d6090da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f3d63079104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f3d63076d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f3d688661cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f3d6886648e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f3d68866594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f3d6882cc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f3d68836ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f3d627da0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f3d627cf954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f3d636336db start_thread at ??:0
@ 0x7f3d5f40a61f clone at ??:0
W20260929 06:41:42.261235 32440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:42.261528 32440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:42.261567 32440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:42.263378 32440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:42.263443 32440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:42.263485 32440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:41:42.265602 32440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:46759
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=42449
--tserver_master_addrs=127.15.157.190:38727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:42.265870 32440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:42.266178 32440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:42.271715 32479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:42.271710 32482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:42.271708 32480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:42.272179 32440 server_base.cc:1034] running on GCE node
I20260929 06:41:42.272389 32440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:42.272640 32440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:42.273797 32440 hybrid_clock.cc:648] HybridClock initialized: now 1790664102273787 us; error 35 us; skew 500 ppm
Sep 29 06:41:42 dist-test-slave-ltw5 krb5kdc[31299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664102, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:42.276386 32440 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:41:42.276844 32440 webserver.cc:460] Webserver started at http://127.15.157.129:42449/ using document root <none> and password file <none>
I20260929 06:41:42.277064 32440 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:42.277130 32440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:42.278540 32440 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:41:42.279264 32489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:42.279455 32440 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:41:42.279561 32440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef"
format_stamp: "Formatted at 2026-09-29 06:41:00 on dist-test-slave-ltw5"
server_key: "58b57df1239d490307c8d309bcfa9cd2"
server_key_iv: "3ead9a86e39bbadf8843f961a75070da"
server_key_version: "encryptionkey@0"
I20260929 06:41:42.279903 32440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:42.298640 32440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:42.301038 32440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:42.301205 32440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:42.301465 32440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:41:42.301975 32496 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 06:41:42.303968 32440 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 06:41:42.304039 32440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 06:41:42.304081 32440 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 06:41:42.304738 32440 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 06:41:42.304792 32440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 06:41:42.304893 32496 tablet_bootstrap.cc:492] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef: Bootstrap starting.
I20260929 06:41:42.311924 32440 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:46759
I20260929 06:41:42.312084 32603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:46759 every 8 connection(s)
I20260929 06:41:42.312407 32440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:41:42.315950 32496 log.cc:824] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:42.318665 32496 tablet_bootstrap.cc:492] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:41:42.318993 32496 tablet_bootstrap.cc:492] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef: Bootstrap complete.
I20260929 06:41:42.320155 32496 ts_tablet_manager.cc:1397] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.003s
I20260929 06:41:42.321658 32496 raft_consensus.cc:348] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:42.322044 32496 raft_consensus.cc:729] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6385f13732ee4c0c80a99d1bd7c0b3ef, State: Initialized, Role: FOLLOWER
I20260929 06:41:42.322208 32496 consensus_queue.cc:260] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:42.322376 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 32440
I20260929 06:41:42.322485 32496 ts_tablet_manager.cc:1428] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef: Time spent starting tablet: real 0.002s user 0.001s sys 0.003s
I20260929 06:41:42.322679 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:34209
--local_ip_for_outbound_sockets=127.15.157.130
--tserver_master_addrs=127.15.157.190:38727
--webserver_port=44309
--webserver_interface=127.15.157.130
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:41:42.377411 32606 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:41:42.313209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:49831)
0929 06:41:42.313381 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:42.313424 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:42.313887 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:42.377209 (+ 63322us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":96,"threads_started":1}
W20260929 06:41:42.377678 32604 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:38727 (0 consecutive failures): Network error: Failed to ping master at 127.15.157.190:38727: Client connection negotiation failed: client connection to 127.15.157.190:38727: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 06:41:42.378074 32606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:42.377918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:43507)
0929 06:41:42.377973 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:42.378011 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 06:41:42.378402 32606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:42.378344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:58001)
0929 06:41:42.378369 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:42.378389 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260929 06:41:42.378520 32604 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 06:41:42.407610 32609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:42.407847 32609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:42.407886 32609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:42.409021 32609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:42.409085 32609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:42.409132 32609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:41:42.410641 32609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:34209
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=44309
--tserver_master_addrs=127.15.157.190:38727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:42.410899 32609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:42.411131 32609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:42.416101 32617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:42.416155 32615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:42.416208 32609 server_base.cc:1034] running on GCE node
W20260929 06:41:42.416152 32614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:42.416548 32609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:42.416814 32609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:42.417975 32609 hybrid_clock.cc:648] HybridClock initialized: now 1790664102417952 us; error 59 us; skew 500 ppm
Sep 29 06:41:42 dist-test-slave-ltw5 krb5kdc[31299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664102, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:42.420295 32609 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:41:42.420704 32609 webserver.cc:460] Webserver started at http://127.15.157.130:44309/ using document root <none> and password file <none>
I20260929 06:41:42.420948 32609 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:42.421015 32609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:42.422436 32609 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:41:42.423043 32624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:42.423197 32609 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:41:42.423291 32609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "1ad41c2b5aea4135981139fbb505e129"
format_stamp: "Formatted at 2026-09-29 06:41:01 on dist-test-slave-ltw5"
server_key: "218a026abd6316f5a6c1e14db313e177"
server_key_iv: "5fa6eba13ed9be8b7f9a6e48e4f36e0a"
server_key_version: "encryptionkey@0"
I20260929 06:41:42.423629 32609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:42.433176 32609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:42.435096 32609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:42.435250 32609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:42.435460 32609 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:41:42.435750 32609 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:41:42.435801 32609 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:42.435840 32609 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:41:42.435868 32609 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:42.441423 32609 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:34209
I20260929 06:41:42.441519 32737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:34209 every 8 connection(s)
I20260929 06:41:42.441829 32609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:41:42.442947 32740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:42.442567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:60325)
0929 06:41:42.442717 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:42.442811 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
W20260929 06:41:42.443363 32738 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:38727 (0 consecutive failures): Network error: Failed to ping master at 127.15.157.190:38727: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
I20260929 06:41:42.443641 32740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:42.443552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:42831)
0929 06:41:42.443600 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:42.443625 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 06:41:42.443897 32740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:42.443828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:34679)
0929 06:41:42.443863 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:42.443884 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260929 06:41:42.444013 32738 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260929 06:41:42.447575 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 32609
I20260929 06:41:42.447893 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:41775
--local_ip_for_outbound_sockets=127.15.157.131
--tserver_master_addrs=127.15.157.190:38727
--webserver_port=38841
--webserver_interface=127.15.157.131
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:41:42.531885 32741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:42.532073 32741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:42.532095 32741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:42.533246 32741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:42.533286 32741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:42.533313 32741 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:41:42.534822 32741 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:41775
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=38841
--tserver_master_addrs=127.15.157.190:38727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:42.535065 32741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:42.535312 32741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:42.540230 32749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:42.540303 32746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:42.540225 32747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:42.540557 32741 server_base.cc:1034] running on GCE node
I20260929 06:41:42.540773 32741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:42.541061 32741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:42.542233 32741 hybrid_clock.cc:648] HybridClock initialized: now 1790664102542211 us; error 35 us; skew 500 ppm
Sep 29 06:41:42 dist-test-slave-ltw5 krb5kdc[31299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664102, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:42.544600 32741 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:41:42.545001 32741 webserver.cc:460] Webserver started at http://127.15.157.131:38841/ using document root <none> and password file <none>
I20260929 06:41:42.545241 32741 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:42.545305 32741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:42.546660 32741 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:41:42.547207 32756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:42.547372 32741 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:41:42.547464 32741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "eb223996462c4bacb693484beaa53bc1"
format_stamp: "Formatted at 2026-09-29 06:41:01 on dist-test-slave-ltw5"
server_key: "642aab66cf413f7722716b51e997897a"
server_key_iv: "00f51f90bb234ced7a9b6e17dc296704"
server_key_version: "encryptionkey@0"
I20260929 06:41:42.547782 32741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:42.570269 32741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:42.572219 32741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:42.572383 32741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:42.572633 32741 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:41:42.572932 32741 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:41:42.572983 32741 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:42.573021 32741 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:41:42.573050 32741 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:42.578711 32741 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:41775
I20260929 06:41:42.578773 401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:41775 every 8 connection(s)
I20260929 06:41:42.579123 32741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:41:42.580080 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:42.579733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:38107)
0929 06:41:42.579876 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:42.579944 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":69,"threads_started":1}
W20260929 06:41:42.580505 402 heartbeater.cc:644] Failed to heartbeat to 127.15.157.190:38727 (0 consecutive failures): Network error: Failed to ping master at 127.15.157.190:38727: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
I20260929 06:41:42.580788 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:42.580686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:36707)
0929 06:41:42.580735 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:42.580759 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 06:41:42.581058 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:42.580974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:37745)
0929 06:41:42.581017 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:42.581039 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 06:41:42.581163 402 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260929 06:41:42.582646 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 32741
I20260929 06:41:43.379208 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:43.378972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:44649)
0929 06:41:43.379101 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:43.379147 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":60,"threads_started":1}
I20260929 06:41:43.444518 407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:43.444315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:53901)
0929 06:41:43.444434 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:43.444467 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":57,"threads_started":1}
I20260929 06:41:43.559698 408 raft_consensus.cc:482] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:41:43.559819 408 raft_consensus.cc:504] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:43.560163 408 leader_election.cc:288] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775), 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130:34209)
Sep 29 06:41:43 dist-test-slave-ltw5 krb5kdc[31299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664102, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.131@KRBTEST.COM
Sep 29 06:41:43 dist-test-slave-ltw5 krb5kdc[31299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664102, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.130@KRBTEST.COM
I20260929 06:41:43.576372 411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:43.560549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:52177 (local address 127.15.157.130:34209)
0929 06:41:43.560703 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:43.560709 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:43.560732 (+ 23us) server_negotiation.cc:407] Connection header received
0929 06:41:43.561245 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:43.561248 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:43.561298 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:43.561458 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:43.562253 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:43.563111 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:43.564135 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:43.564522 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:43.564646 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:43.571409 (+ 6763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:43.571414 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:43.571414 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:43.571428 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:43.574773 (+ 3345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:43.575116 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:43.575119 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:43.575119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:43.575220 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:43.575449 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:43.575450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:43.575450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:43.575742 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:43.575821 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:43.576100 (+ 279us) server_negotiation.cc:299] Negotiation successful
0929 06:41:43.576256 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":59,"threads_started":1}
I20260929 06:41:43.576421 409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:43.560452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:34209 (local address 127.15.157.129:52177)
0929 06:41:43.560540 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:43.560549 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:43.560583 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:43.561587 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:43.561588 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:43.561851 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:41:43.562129 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:43.562135 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:43.563228 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:43.563229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:43.564040 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:43.564042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:43.564619 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:43.564620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:43.564740 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:43.565399 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:41:43.565405 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:41:43.571277 (+ 5872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:41:43.574844 (+ 3567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:43.574845 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:43.574845 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:43.575038 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:43.575293 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:43.575294 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:43.575294 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:43.575369 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:43.575813 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:41:43.575814 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:41:43.575881 (+ 67us) client_negotiation.cc:769] Sending connection context
0929 06:41:43.576036 (+ 155us) client_negotiation.cc:240] Negotiation successful
0929 06:41:43.576259 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76,"mutex_wait_us":5,"thread_start_us":52,"threads_started":1}
I20260929 06:41:43.576522 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:43.560479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:58207 (local address 127.15.157.131:41775)
0929 06:41:43.560623 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:43.560636 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:43.560667 (+ 31us) server_negotiation.cc:407] Connection header received
0929 06:41:43.561233 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:43.561237 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:43.561302 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:43.561458 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:43.562256 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:43.563153 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:43.564100 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:43.564518 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:43.564646 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:43.571436 (+ 6790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:43.571439 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:43.571440 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:43.571451 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:43.574372 (+ 2921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:43.574787 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:43.574791 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:43.574792 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:43.574917 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:43.575241 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:43.575242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:43.575242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:43.575582 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:43.576218 (+ 636us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:43.576287 (+ 69us) server_negotiation.cc:299] Negotiation successful
0929 06:41:43.576411 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":53,"threads_started":1}
I20260929 06:41:43.577558 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:43.560309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:41775 (local address 127.15.157.129:58207)
0929 06:41:43.560367 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:43.560381 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:43.560452 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:43.561512 (+ 1060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:43.561514 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:43.561849 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:41:43.562129 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:43.562135 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:43.563261 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:43.563262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:43.564008 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:43.564010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:43.564622 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:43.564623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:43.564753 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:43.565368 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:41:43.565379 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:41:43.571299 (+ 5920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:41:43.574475 (+ 3176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:43.574483 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:43.574486 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:43.574719 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:43.575007 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:43.575008 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:43.575008 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:43.575158 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:43.575672 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:41:43.575678 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:41:43.576046 (+ 368us) client_negotiation.cc:769] Sending connection context
0929 06:41:43.576100 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 06:41:43.576331 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":180}
W20260929 06:41:43.578320 32490 leader_election.cc:341] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130:34209): Not found: Tablet not found: 72d1570b76924e6a94547ec7a00968fd
W20260929 06:41:43.578397 32490 leader_election.cc:341] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775): Not found: Tablet not found: 72d1570b76924e6a94547ec7a00968fd
I20260929 06:41:43.578414 32490 leader_election.cc:302] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6385f13732ee4c0c80a99d1bd7c0b3ef; no voters: 1ad41c2b5aea4135981139fbb505e129, eb223996462c4bacb693484beaa53bc1
I20260929 06:41:43.578559 408 raft_consensus.cc:2726] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:41:43.581858 412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:43.581543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:46105)
0929 06:41:43.581647 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:43.581818 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":66,"threads_started":1}
I20260929 06:41:44.379992 413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:44.379758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:56403)
0929 06:41:44.379904 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:44.379947 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":66,"threads_started":1}
I20260929 06:41:44.445210 414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:44.445034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:41461)
0929 06:41:44.445140 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:44.445173 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":53,"threads_started":1}
I20260929 06:41:44.582458 415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:44.582249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:54463)
0929 06:41:44.582371 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:44.582405 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":62,"threads_started":1}
I20260929 06:41:45.207165 416 raft_consensus.cc:482] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:41:45.207306 416 raft_consensus.cc:504] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:45.207513 416 leader_election.cc:288] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775), 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130:34209)
W20260929 06:41:45.207978 32490 leader_election.cc:341] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775): Not found: Tablet not found: 72d1570b76924e6a94547ec7a00968fd
W20260929 06:41:45.208041 32490 leader_election.cc:341] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130:34209): Not found: Tablet not found: 72d1570b76924e6a94547ec7a00968fd
I20260929 06:41:45.208058 32490 leader_election.cc:302] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6385f13732ee4c0c80a99d1bd7c0b3ef; no voters: 1ad41c2b5aea4135981139fbb505e129, eb223996462c4bacb693484beaa53bc1
I20260929 06:41:45.208124 416 raft_consensus.cc:2726] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:41:45.380669 417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:45.380443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:52663)
0929 06:41:45.380567 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:45.380603 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260929 06:41:45.445909 418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:45.445638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:33767)
0929 06:41:45.445829 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:45.445868 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":56,"threads_started":1}
I20260929 06:41:45.583190 419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:45.582982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:54095)
0929 06:41:45.583111 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:45.583149 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":59,"threads_started":1}
I20260929 06:41:46.381358 420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:46.381143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:50645)
0929 06:41:46.381277 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:46.381311 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":76,"threads_started":1}
I20260929 06:41:46.446609 421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:46.446386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:51113)
0929 06:41:46.446528 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:46.446566 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":59,"threads_started":1}
I20260929 06:41:46.583904 422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:46.583680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:34489)
0929 06:41:46.583809 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:46.583853 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":62,"threads_started":1}
I20260929 06:41:47.382104 423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:47.381883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:34485)
0929 06:41:47.382005 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:47.382059 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260929 06:41:47.447326 424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:47.447099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:34875)
0929 06:41:47.447247 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:47.447285 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":73,"threads_started":1}
I20260929 06:41:47.584569 425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:47.584358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:54727)
0929 06:41:47.584492 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:47.584530 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":59,"threads_started":1}
I20260929 06:41:48.097487 426 raft_consensus.cc:482] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:41:48.097618 426 raft_consensus.cc:504] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:48.097813 426 leader_election.cc:288] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775), 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130:34209)
W20260929 06:41:48.098297 32490 leader_election.cc:341] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775): Not found: Tablet not found: 72d1570b76924e6a94547ec7a00968fd
W20260929 06:41:48.098387 32490 leader_election.cc:341] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130:34209): Not found: Tablet not found: 72d1570b76924e6a94547ec7a00968fd
I20260929 06:41:48.098436 32490 leader_election.cc:302] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6385f13732ee4c0c80a99d1bd7c0b3ef; no voters: 1ad41c2b5aea4135981139fbb505e129, eb223996462c4bacb693484beaa53bc1
I20260929 06:41:48.098521 426 raft_consensus.cc:2726] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:41:48.382810 427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:48.382566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:44585)
0929 06:41:48.382714 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:48.382761 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":60,"threads_started":1}
I20260929 06:41:48.448036 428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:48.447790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:34843)
0929 06:41:48.447950 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:48.447987 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":80,"threads_started":1}
I20260929 06:41:48.585216 429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:48.585039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:56997)
0929 06:41:48.585150 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:48.585179 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":59,"threads_started":1}
I20260929 06:41:49.383494 430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:49.383214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:34907)
0929 06:41:49.383360 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:49.383438 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":65,"threads_started":1}
I20260929 06:41:49.448696 431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:49.448498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:60259)
0929 06:41:49.448621 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:49.448654 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
I20260929 06:41:49.585872 432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:49.585671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:48315)
0929 06:41:49.585796 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:49.585832 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":60,"threads_started":1}
I20260929 06:41:50.384136 433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:50.383939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:35757)
0929 06:41:50.384057 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:50.384088 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":58,"threads_started":1}
I20260929 06:41:50.449378 434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:50.449191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:51443)
0929 06:41:50.449304 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:50.449339 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":58,"threads_started":1}
I20260929 06:41:50.586534 435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:50.586331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:35745)
0929 06:41:50.586462 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:50.586497 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
I20260929 06:41:51.384786 436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:51.384585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:46867)
0929 06:41:51.384704 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:51.384740 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":60,"threads_started":1}
I20260929 06:41:51.450196 437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:51.449898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:60065)
0929 06:41:51.450090 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:51.450149 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":70,"threads_started":1}
I20260929 06:41:51.587211 438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:51.586993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:60565)
0929 06:41:51.587126 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:51.587167 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":74,"threads_started":1}
I20260929 06:41:52.255852 439 raft_consensus.cc:482] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:41:52.255942 439 raft_consensus.cc:504] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb223996462c4bacb693484beaa53bc1" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 41775 } } peers { permanent_uuid: "1ad41c2b5aea4135981139fbb505e129" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34209 } } peers { permanent_uuid: "6385f13732ee4c0c80a99d1bd7c0b3ef" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 46759 } }
I20260929 06:41:52.256062 439 leader_election.cc:288] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775), 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130:34209)
W20260929 06:41:52.256502 32490 leader_election.cc:341] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad41c2b5aea4135981139fbb505e129 (127.15.157.130:34209): Not found: Tablet not found: 72d1570b76924e6a94547ec7a00968fd
W20260929 06:41:52.256579 32490 leader_election.cc:341] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eb223996462c4bacb693484beaa53bc1 (127.15.157.131:41775): Not found: Tablet not found: 72d1570b76924e6a94547ec7a00968fd
I20260929 06:41:52.256598 32490 leader_election.cc:302] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6385f13732ee4c0c80a99d1bd7c0b3ef; no voters: 1ad41c2b5aea4135981139fbb505e129, eb223996462c4bacb693484beaa53bc1
I20260929 06:41:52.256672 439 raft_consensus.cc:2726] T 72d1570b76924e6a94547ec7a00968fd P 6385f13732ee4c0c80a99d1bd7c0b3ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:41:52.385558 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:52.385344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:51695)
0929 06:41:52.385462 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:52.385512 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":61,"threads_started":1}
I20260929 06:41:52.450865 441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:52.450659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:51059)
0929 06:41:52.450788 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:52.450822 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
I20260929 06:41:52.587890 442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:52.587652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:34791)
0929 06:41:52.587805 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:52.587846 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":74,"threads_started":1}
I20260929 06:41:53.386358 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:53.386101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:33101)
0929 06:41:53.386267 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:53.386309 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":83,"threads_started":1}
I20260929 06:41:53.451447 444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:53.451267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:42755)
0929 06:41:53.451376 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:53.451406 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":55,"threads_started":1}
I20260929 06:41:53.588562 445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:53.588348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:42749)
0929 06:41:53.588482 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:53.588517 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":60,"threads_started":1}
I20260929 06:41:54.387040 446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:54.386786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:39705)
0929 06:41:54.386949 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:54.386991 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":64,"threads_started":1}
I20260929 06:41:54.452098 447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:54.451899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:40093)
0929 06:41:54.452020 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:54.452056 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
I20260929 06:41:54.589197 448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:54.588980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:36711)
0929 06:41:54.589105 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:54.589151 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
I20260929 06:41:55.387750 449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:55.387532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:50773)
0929 06:41:55.387661 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:55.387705 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":59,"threads_started":1}
I20260929 06:41:55.452742 450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:55.452556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:56475)
0929 06:41:55.452661 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:55.452697 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":50,"threads_started":1}
I20260929 06:41:55.589972 451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:55.589722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:57611)
0929 06:41:55.589882 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:55.589924 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":68,"threads_started":1}
I20260929 06:41:56.388417 452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:56.388201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:40171)
0929 06:41:56.388338 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:56.388372 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
I20260929 06:41:56.453410 453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:56.453191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:50349)
0929 06:41:56.453321 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:56.453363 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260929 06:41:56.590718 454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:56.590479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:60793)
0929 06:41:56.590632 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:56.590674 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":73,"threads_started":1}
I20260929 06:41:57.389180 455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:57.388956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.129:42193)
0929 06:41:57.389095 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:57.389135 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":60,"threads_started":1}
I20260929 06:41:57.454283 456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:57.454087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.130:60157)
0929 06:41:57.454201 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:57.454239 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":56,"threads_started":1}
I20260929 06:41:57.591477 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:57.591268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38727 (local address 127.15.157.131:37979)
0929 06:41:57.591400 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:57.591436 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.190:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":71,"threads_started":1}
I20260929 06:41:57.592382 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 32440
I20260929 06:41:57.596963 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 32609
I20260929 06:41:57.601464 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 32741
2026-09-29T06:41:57Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58162 ms)
[----------] 30 tests from SecurityITest (227550 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:41:57 dist-test-slave-ltw5 krb5kdc[460](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:41:57 dist-test-slave-ltw5 krb5kdc[460](info): set up 2 sockets
Sep 29 06:41:57 dist-test-slave-ltw5 krb5kdc[460](info): commencing operation
krb5kdc: starting...
W20260929 06:41:58.633834 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.012s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:41:58 dist-test-slave-ltw5 krb5kdc[460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:41:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:41:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:41:58.751983 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:46147
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:46147
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:41:58.830964 473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:58.831203 473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:58.831240 473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:58.832363 473 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:41:58.832430 473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:58.832453 473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:58.832475 473 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:41:58.832504 473 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:41:58.833997 473 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:46147
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:46147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:58.834290 473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:58.834506 473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:58.839670 478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:58.839651 479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:58.839790 473 server_base.cc:1034] running on GCE node
W20260929 06:41:58.839646 481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:58.840212 473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:58.840507 473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:58.841661 473 hybrid_clock.cc:648] HybridClock initialized: now 1790664118841649 us; error 30 us; skew 500 ppm
Sep 29 06:41:58 dist-test-slave-ltw5 krb5kdc[460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664118, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:58.849746 473 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:41:58.850220 473 webserver.cc:460] Webserver started at http://127.15.157.190:45859/ using document root <none> and password file <none>
I20260929 06:41:58.850409 473 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:58.850450 473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:58.850541 473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:41:58.851548 473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "d4188960ae7447e9b4006963024733af"
format_stamp: "Formatted at 2026-09-29 06:41:58 on dist-test-slave-ltw5"
server_key: "80815a91f6d03ea059bff297890e3c6f"
server_key_iv: "d7e2d818298b280c4802d3057f911cd2"
server_key_version: "encryptionkey@0"
I20260929 06:41:58.851858 473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "d4188960ae7447e9b4006963024733af"
format_stamp: "Formatted at 2026-09-29 06:41:58 on dist-test-slave-ltw5"
server_key: "80815a91f6d03ea059bff297890e3c6f"
server_key_iv: "d7e2d818298b280c4802d3057f911cd2"
server_key_version: "encryptionkey@0"
I20260929 06:41:58.853108 473 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:41:58.853775 488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:58.853930 473 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:41:58.854058 473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "d4188960ae7447e9b4006963024733af"
format_stamp: "Formatted at 2026-09-29 06:41:58 on dist-test-slave-ltw5"
server_key: "80815a91f6d03ea059bff297890e3c6f"
server_key_iv: "d7e2d818298b280c4802d3057f911cd2"
server_key_version: "encryptionkey@0"
I20260929 06:41:58.854133 473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:58.865103 473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:58.866967 473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:58.867074 473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:58.870792 473 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:46147
I20260929 06:41:58.870842 540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:46147 every 8 connection(s)
I20260929 06:41:58.871176 473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:41:58.872036 541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:41:58.874373 541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af: Bootstrap starting.
I20260929 06:41:58.874938 541 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af: Neither blocks nor log segments found. Creating new log.
I20260929 06:41:58.875221 541 log.cc:824] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:58.875886 541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af: No bootstrap required, opened a new log
I20260929 06:41:58.876430 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 473
I20260929 06:41:58.876518 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:41:58.876739 15990 external_mini_cluster.cc:1428] Setting key aaab70bbdcfa148a7395d8bda3241645
I20260929 06:41:58.878170 541 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4188960ae7447e9b4006963024733af" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46147 } }
I20260929 06:41:58.878350 541 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:41:58.878388 541 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4188960ae7447e9b4006963024733af, State: Initialized, Role: FOLLOWER
I20260929 06:41:58.878545 541 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4188960ae7447e9b4006963024733af" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46147 } }
I20260929 06:41:58.878611 541 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:41:58.878633 541 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:41:58.878696 541 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:41:58.879767 541 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4188960ae7447e9b4006963024733af" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46147 } }
I20260929 06:41:58.879873 541 leader_election.cc:302] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4188960ae7447e9b4006963024733af; no voters:
I20260929 06:41:58.880023 541 leader_election.cc:288] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:41:58.880082 546 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:41:58.880242 541 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:41:58.880270 546 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [term 1 LEADER]: Becoming Leader. State: Replica: d4188960ae7447e9b4006963024733af, State: Running, Role: LEADER
I20260929 06:41:58.880470 546 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4188960ae7447e9b4006963024733af" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46147 } }
I20260929 06:41:58.880882 547 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4188960ae7447e9b4006963024733af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4188960ae7447e9b4006963024733af" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46147 } } }
I20260929 06:41:58.880959 547 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [sys.catalog]: This master's current role is: LEADER
I20260929 06:41:58.881161 548 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4188960ae7447e9b4006963024733af. Latest consensus state: current_term: 1 leader_uuid: "d4188960ae7447e9b4006963024733af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4188960ae7447e9b4006963024733af" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 46147 } } }
I20260929 06:41:58.881292 548 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af [sys.catalog]: This master's current role is: LEADER
W20260929 06:41:58.882148 562 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:41:58.882213 562 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:41:58.882261 555 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:41:58.882432 555 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:41:58.883930 555 catalog_manager.cc:1347] Generated new cluster ID: 3248a33881d3443fbbcaf813b7ebddcf
I20260929 06:41:58.883980 555 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:41:58 dist-test-slave-ltw5 krb5kdc[460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:41:58.888820 545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:58.877241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42618 (local address 127.15.157.190:46147)
0929 06:41:58.877440 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:58.877449 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:58.877483 (+ 34us) server_negotiation.cc:407] Connection header received
0929 06:41:58.878128 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:58.878137 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:58.878210 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:58.878361 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:58.879127 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:58.880533 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:58.881750 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:58.882364 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:58.882483 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:58.885238 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:58.885241 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:58.885242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:58.885252 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:58.887173 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:58.887615 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:58.887617 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:58.887618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:58.887738 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:58.887972 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:58.887973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:58.887973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:58.888251 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:58.888397 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:58.888513 (+ 116us) server_negotiation.cc:299] Negotiation successful
0929 06:41:58.888637 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":92,"threads_started":1}
I20260929 06:41:58.910410 555 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:41:58.910943 555 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:41:58.912937 555 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af: Generated new TSK 0
I20260929 06:41:58.913139 555 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:41:58.944802 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46147
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:41:59.026170 567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:59.026372 567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:59.026396 567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:59.027565 567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:59.027607 567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:59.027633 567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:41:59.029089 567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:59.029323 567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:59.029560 567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:59.034678 572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:59.034708 575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:59.034897 567 server_base.cc:1034] running on GCE node
W20260929 06:41:59.034730 573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:59.035163 567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:59.035415 567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:59.036588 567 hybrid_clock.cc:648] HybridClock initialized: now 1790664119036583 us; error 41 us; skew 500 ppm
Sep 29 06:41:59 dist-test-slave-ltw5 krb5kdc[460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664119, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:59.039175 567 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:41:59.039639 567 webserver.cc:460] Webserver started at http://127.15.157.129:41817/ using document root <none> and password file <none>
I20260929 06:41:59.039824 567 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:59.039863 567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:59.039950 567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:41:59.040973 567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "c40b3860816241f6bbb0f6499d61d398"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "a1003d713b73516f6c0a3661402dfe79"
server_key_iv: "c7580a16748f7b37184e3041e7a0a5b2"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.041272 567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "c40b3860816241f6bbb0f6499d61d398"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "a1003d713b73516f6c0a3661402dfe79"
server_key_iv: "c7580a16748f7b37184e3041e7a0a5b2"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.042797 567 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:41:59.043581 582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.043788 567 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:41:59.043869 567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "c40b3860816241f6bbb0f6499d61d398"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "a1003d713b73516f6c0a3661402dfe79"
server_key_iv: "c7580a16748f7b37184e3041e7a0a5b2"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.043924 567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:59.056294 567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:59.058609 567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:59.058764 567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:59.058993 567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:41:59.059307 567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:41:59.059361 567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.059408 567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:41:59.059432 567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.064806 567 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:43537
I20260929 06:41:59.064873 695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:43537 every 8 connection(s)
I20260929 06:41:59.065202 567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:41:59.069650 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 567
I20260929 06:41:59.069787 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:41:59.069972 15990 external_mini_cluster.cc:1428] Setting key 8b2a175b11597b4546201c4b6a07d453
Sep 29 06:41:59 dist-test-slave-ltw5 krb5kdc[460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664119, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:41:59.074980 545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.066007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:57099 (local address 127.15.157.190:46147)
0929 06:41:59.066091 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:59.066093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:59.066284 (+ 191us) server_negotiation.cc:407] Connection header received
0929 06:41:59.066733 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:59.066734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:59.066747 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:59.066808 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:59.067700 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.068195 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.069138 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.069340 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.069391 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.072008 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:59.072010 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:59.072010 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:59.072021 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:59.073495 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:59.073941 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:59.073942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:59.073943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:59.074001 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:59.074293 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:59.074294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:59.074294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:59.074411 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:59.074490 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:59.074780 (+ 290us) server_negotiation.cc:299] Negotiation successful
0929 06:41:59.074884 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260929 06:41:59.075155 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.065961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46147 (local address 127.15.157.129:57099)
0929 06:41:59.066152 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:59.066187 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:59.066651 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:59.066871 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:59.066875 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:59.067441 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:41:59.067626 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.067632 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.068275 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.068276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.069064 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.069066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.069415 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.069415 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.069519 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.070147 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:41:59.070155 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:41:59.071901 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:41:59.073609 (+ 1708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:59.073616 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:59.073619 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:59.073853 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:59.074100 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:59.074100 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:59.074101 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:59.074222 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:59.074481 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:41:59.074488 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:41:59.074630 (+ 142us) client_negotiation.cc:769] Sending connection context
0929 06:41:59.074755 (+ 125us) client_negotiation.cc:240] Negotiation successful
0929 06:41:59.074914 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":115,"threads_started":1}
I20260929 06:41:59.075624 696 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46147
I20260929 06:41:59.075718 696 heartbeater.cc:464] Registering TS with master...
I20260929 06:41:59.075914 696 heartbeater.cc:511] Master 127.15.157.190:46147 requested a full tablet report, sending...
I20260929 06:41:59.076439 505 ts_manager.cc:194] Registered new tserver with Master: c40b3860816241f6bbb0f6499d61d398 (127.15.157.129:43537)
I20260929 06:41:59.077009 505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:57099
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:41:59.095094 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46147
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:41:59.175482 701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:59.175686 701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:59.175709 701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:59.176865 701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:59.176908 701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:59.176934 701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:41:59.178398 701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:59.178638 701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:59.178874 701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:59.183892 709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:59.183926 707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:59.183899 706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:59.183929 701 server_base.cc:1034] running on GCE node
I20260929 06:41:59.184232 701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:59.184415 701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:59.185582 701 hybrid_clock.cc:648] HybridClock initialized: now 1790664119185565 us; error 46 us; skew 500 ppm
Sep 29 06:41:59 dist-test-slave-ltw5 krb5kdc[460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664119, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:59.187947 701 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:41:59.188385 701 webserver.cc:460] Webserver started at http://127.15.157.130:37079/ using document root <none> and password file <none>
I20260929 06:41:59.188567 701 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:59.188607 701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:59.188691 701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:41:59.189636 701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "a2494ad8ce664d59a6191f059167288c"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "b5334496933675bf764069177cbbd306"
server_key_iv: "be4041e22700013b1b2183de98a9a6b1"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.189944 701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "a2494ad8ce664d59a6191f059167288c"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "b5334496933675bf764069177cbbd306"
server_key_iv: "be4041e22700013b1b2183de98a9a6b1"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.191212 701 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:41:59.191879 716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.192066 701 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:41:59.192135 701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "a2494ad8ce664d59a6191f059167288c"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "b5334496933675bf764069177cbbd306"
server_key_iv: "be4041e22700013b1b2183de98a9a6b1"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.192185 701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:59.212787 701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:59.214857 701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:59.214973 701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:59.215157 701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:41:59.215483 701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:41:59.215519 701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.215543 701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:41:59.215592 701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.221522 701 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:43195
I20260929 06:41:59.221572 829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:43195 every 8 connection(s)
I20260929 06:41:59.221886 701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:41:59 dist-test-slave-ltw5 krb5kdc[460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664119, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:41:59.229745 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 701
I20260929 06:41:59.229885 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:41:59.230129 15990 external_mini_cluster.cc:1428] Setting key 9f196ebcb91c5f955c6a433d5691f92c
I20260929 06:41:59.230804 545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.222561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:55945 (local address 127.15.157.190:46147)
0929 06:41:59.222639 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:59.222642 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:59.222825 (+ 183us) server_negotiation.cc:407] Connection header received
0929 06:41:59.223319 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:59.223320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:59.223330 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:59.223394 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:59.224325 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.224823 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.225758 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.225939 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.225988 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.228109 (+ 2121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:59.228110 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:59.228111 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:59.228117 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:59.229308 (+ 1191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:59.229685 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:59.229687 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:59.229687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:59.229750 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:59.230067 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:59.230068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:59.230069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:59.230187 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:59.230286 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:59.230607 (+ 321us) server_negotiation.cc:299] Negotiation successful
0929 06:41:59.230689 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260929 06:41:59.231161 832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.222512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46147 (local address 127.15.157.130:55945)
0929 06:41:59.222670 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:59.222711 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:59.223231 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:59.223471 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:59.223474 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:59.224055 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:41:59.224250 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.224255 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.224900 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.224901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.225680 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.225681 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.226008 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.226009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.226173 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.226706 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:41:59.226715 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:41:59.228022 (+ 1307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:41:59.229379 (+ 1357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:59.229385 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:59.229386 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:59.229589 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:59.229820 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:59.229821 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:59.229822 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:59.229985 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:59.230277 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:41:59.230284 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:41:59.230454 (+ 170us) client_negotiation.cc:769] Sending connection context
0929 06:41:59.230572 (+ 118us) client_negotiation.cc:240] Negotiation successful
0929 06:41:59.230694 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":94,"threads_started":1}
I20260929 06:41:59.231806 830 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46147
I20260929 06:41:59.231928 830 heartbeater.cc:464] Registering TS with master...
I20260929 06:41:59.232110 830 heartbeater.cc:511] Master 127.15.157.190:46147 requested a full tablet report, sending...
I20260929 06:41:59.232551 505 ts_manager.cc:194] Registered new tserver with Master: a2494ad8ce664d59a6191f059167288c (127.15.157.130:43195)
I20260929 06:41:59.232936 505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:55945
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:41:59.256148 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46147
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:41:59.336864 835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:59.337105 835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:59.337129 835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:59.338333 835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:59.338374 835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:59.338402 835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:41:59.339859 835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:46147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:59.340093 835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:59.340346 835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:59.345299 841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:59.345399 843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:59.345291 840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:59.345633 835 server_base.cc:1034] running on GCE node
I20260929 06:41:59.345897 835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:59.346163 835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:59.347306 835 hybrid_clock.cc:648] HybridClock initialized: now 1790664119347294 us; error 32 us; skew 500 ppm
Sep 29 06:41:59 dist-test-slave-ltw5 krb5kdc[460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664119, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:41:59.349888 835 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:41:59.350457 835 webserver.cc:460] Webserver started at http://127.15.157.131:43337/ using document root <none> and password file <none>
I20260929 06:41:59.350679 835 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:59.350730 835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:59.350903 835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:41:59.351974 835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "2f640295de344826b3ca8769c5c2c2d9"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "dcdbc0a72ea60075aae37cae039c97e9"
server_key_iv: "a8f8ffbc84ebaef38953fc1629a1c4c3"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.352335 835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "2f640295de344826b3ca8769c5c2c2d9"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "dcdbc0a72ea60075aae37cae039c97e9"
server_key_iv: "a8f8ffbc84ebaef38953fc1629a1c4c3"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.353667 835 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:41:59.354501 850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.354671 835 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.354755 835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "2f640295de344826b3ca8769c5c2c2d9"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "dcdbc0a72ea60075aae37cae039c97e9"
server_key_iv: "a8f8ffbc84ebaef38953fc1629a1c4c3"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.354812 835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:59.370780 835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:59.373098 835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:59.373212 835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:59.373405 835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:41:59.373732 835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:41:59.373769 835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.373817 835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:41:59.373843 835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.379578 835 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:35731
I20260929 06:41:59.379655 963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:35731 every 8 connection(s)
I20260929 06:41:59.380009 835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:41:59.381022 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 835
I20260929 06:41:59.381151 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:41:59.381340 15990 external_mini_cluster.cc:1428] Setting key f6f1ea8d048c2a5f80c9568429b6bdc3
Sep 29 06:41:59 dist-test-slave-ltw5 krb5kdc[460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664119, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:41:59.389562 545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.380757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:49843 (local address 127.15.157.190:46147)
0929 06:41:59.380810 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:59.380812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:59.381100 (+ 288us) server_negotiation.cc:407] Connection header received
0929 06:41:59.381815 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:59.381816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:59.381828 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:59.381875 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:59.382951 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.383441 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.384388 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.384571 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.384620 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.386791 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:59.386793 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:59.386794 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:59.386801 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:59.388280 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:59.388693 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:59.388694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:59.388694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:59.388740 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:59.389037 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:59.389037 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:59.389038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:59.389138 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:59.389188 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:59.389436 (+ 248us) server_negotiation.cc:299] Negotiation successful
0929 06:41:59.389496 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:41:59.389779 966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.380731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:46147 (local address 127.15.157.131:49843)
0929 06:41:59.380917 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:59.381006 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:59.381664 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:59.381975 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:59.381980 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:59.382668 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:41:59.382866 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.382872 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.383519 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.383520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.384315 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.384317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.384640 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.384641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.384738 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.385202 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:41:59.385210 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:41:59.386636 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:41:59.388356 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:59.388361 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:59.388363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:59.388584 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:59.388822 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:41:59.388823 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:41:59.388824 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:41:59.388975 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:41:59.389208 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:41:59.389213 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:41:59.389325 (+ 112us) client_negotiation.cc:769] Sending connection context
0929 06:41:59.389409 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 06:41:59.389527 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":87,"threads_started":1}
I20260929 06:41:59.390312 964 heartbeater.cc:347] Connected to a master server at 127.15.157.190:46147
I20260929 06:41:59.390398 964 heartbeater.cc:464] Registering TS with master...
I20260929 06:41:59.390594 964 heartbeater.cc:511] Master 127.15.157.190:46147 requested a full tablet report, sending...
I20260929 06:41:59.390919 505 ts_manager.cc:194] Registered new tserver with Master: 2f640295de344826b3ca8769c5c2c2d9 (127.15.157.131:35731)
I20260929 06:41:59.391299 505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:49843
I20260929 06:41:59.393015 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:41:59.400170 545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.394287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42626 (local address 127.15.157.190:46147)
0929 06:41:59.394325 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:59.394327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:59.394427 (+ 100us) server_negotiation.cc:407] Connection header received
0929 06:41:59.394464 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:59.394464 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:59.394472 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:59.394520 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:59.395137 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.395599 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.396369 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.396547 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.396599 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.397784 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:59.397785 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:59.397786 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:41:59.397791 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:59.399214 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:59.399520 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:59.399521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:59.399521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:59.399568 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:41:59.399717 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:41:59.399718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:41:59.399718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:41:59.399841 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:59.399915 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:59.400054 (+ 139us) server_negotiation.cc:299] Negotiation successful
0929 06:41:59.400109 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:41:59.401904 505 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42626:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:41:59.403541 505 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:41:59.409607 976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.405722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:35731 (local address 127.0.0.1:33372)
0929 06:41:59.406120 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:59.406130 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:59.406202 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:59.406427 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:59.406431 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:59.406433 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:59.406503 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.406505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.407499 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.407500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.408579 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.408581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.409322 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.409323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.409417 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.409432 (+ 15us) client_negotiation.cc:769] Sending connection context
0929 06:41:59.409477 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 06:41:59.409530 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":52,"threads_started":1}
I20260929 06:41:59.410069 975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.405810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33372 (local address 127.15.157.131:35731)
0929 06:41:59.406147 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:59.406153 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:59.406197 (+ 44us) server_negotiation.cc:407] Connection header received
0929 06:41:59.406308 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:59.406311 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:59.406328 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:59.406412 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:59.406589 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.407390 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.408651 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.409223 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.409818 (+ 595us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.409889 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:59.409915 (+ 26us) server_negotiation.cc:299] Negotiation successful
0929 06:41:59.409963 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":96,"threads_started":1}
I20260929 06:41:59.410072 972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.405684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:43195 (local address 127.0.0.1:37912)
0929 06:41:59.405874 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:59.405915 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:59.405982 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:59.406716 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:59.406717 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:59.406720 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:59.406765 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.406766 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.408065 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.408066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.408958 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.408960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.409833 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.409834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.409894 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.409898 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:41:59.409940 (+ 42us) client_negotiation.cc:240] Negotiation successful
0929 06:41:59.409975 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":80,"threads_started":1}
I20260929 06:41:59.410403 974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.405796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37912 (local address 127.15.157.130:43195)
0929 06:41:59.406554 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:59.406559 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:59.406568 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:41:59.406608 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:59.406610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:59.406625 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:59.406700 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:59.406835 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.407951 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.409038 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.409739 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.410194 (+ 455us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.410256 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:59.410279 (+ 23us) server_negotiation.cc:299] Negotiation successful
0929 06:41:59.410320 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":101,"threads_started":1}
I20260929 06:41:59.410784 898 tablet_service.cc:1467] Processing CreateTablet for tablet 1602377276dc4c65bc4aafd7505c22c9 (DEFAULT_TABLE table=test-table [id=2ecd3ffc8d7d4da2b4db0c4e1deab05f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:41:59.411016 764 tablet_service.cc:1467] Processing CreateTablet for tablet 1602377276dc4c65bc4aafd7505c22c9 (DEFAULT_TABLE table=test-table [id=2ecd3ffc8d7d4da2b4db0c4e1deab05f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:41:59.411161 898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1602377276dc4c65bc4aafd7505c22c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:41:59.411391 764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1602377276dc4c65bc4aafd7505c22c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:41:59.411581 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.405904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:43537 (local address 127.0.0.1:40260)
0929 06:41:59.406429 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:59.406439 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:59.406488 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:59.406750 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:59.406751 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:59.406753 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:59.406801 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.406802 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.409029 (+ 2227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.409029 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.409991 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.409993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.411175 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.411176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.411328 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.411333 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:41:59.411401 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 06:41:59.411508 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":32,"threads_started":1}
I20260929 06:41:59.411580 977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.406105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40260 (local address 127.15.157.129:43537)
0929 06:41:59.406318 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:59.406323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:59.406514 (+ 191us) server_negotiation.cc:407] Connection header received
0929 06:41:59.406562 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:59.406564 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:59.406582 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:59.406668 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:59.406883 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.407953 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.410381 (+ 2428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.411075 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.411155 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.411206 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:59.411428 (+ 222us) server_negotiation.cc:299] Negotiation successful
0929 06:41:59.411472 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":112,"threads_started":1}
I20260929 06:41:59.412496 630 tablet_service.cc:1467] Processing CreateTablet for tablet 1602377276dc4c65bc4aafd7505c22c9 (DEFAULT_TABLE table=test-table [id=2ecd3ffc8d7d4da2b4db0c4e1deab05f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:41:59.412829 630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1602377276dc4c65bc4aafd7505c22c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:41:59.414062 978 tablet_bootstrap.cc:492] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9: Bootstrap starting.
I20260929 06:41:59.414710 978 tablet_bootstrap.cc:654] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9: Neither blocks nor log segments found. Creating new log.
I20260929 06:41:59.414727 979 tablet_bootstrap.cc:492] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c: Bootstrap starting.
I20260929 06:41:59.415305 978 log.cc:824] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:59.415385 979 tablet_bootstrap.cc:654] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c: Neither blocks nor log segments found. Creating new log.
I20260929 06:41:59.415911 979 log.cc:824] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:59.415973 981 tablet_bootstrap.cc:492] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398: Bootstrap starting.
I20260929 06:41:59.416309 978 tablet_bootstrap.cc:492] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9: No bootstrap required, opened a new log
I20260929 06:41:59.416378 978 ts_tablet_manager.cc:1397] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:41:59.416564 981 tablet_bootstrap.cc:654] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398: Neither blocks nor log segments found. Creating new log.
I20260929 06:41:59.416669 979 tablet_bootstrap.cc:492] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c: No bootstrap required, opened a new log
I20260929 06:41:59.416724 979 ts_tablet_manager.cc:1397] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:41:59.417281 981 log.cc:824] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:59.417860 978 raft_consensus.cc:348] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2494ad8ce664d59a6191f059167288c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 43195 } } peers { permanent_uuid: "2f640295de344826b3ca8769c5c2c2d9" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35731 } } peers { permanent_uuid: "c40b3860816241f6bbb0f6499d61d398" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43537 } }
I20260929 06:41:59.418059 981 tablet_bootstrap.cc:492] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398: No bootstrap required, opened a new log
I20260929 06:41:59.418056 978 raft_consensus.cc:374] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:41:59.418095 978 raft_consensus.cc:729] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f640295de344826b3ca8769c5c2c2d9, State: Initialized, Role: FOLLOWER
I20260929 06:41:59.418113 981 ts_tablet_manager.cc:1397] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:41:59.418239 978 consensus_queue.cc:260] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2494ad8ce664d59a6191f059167288c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 43195 } } peers { permanent_uuid: "2f640295de344826b3ca8769c5c2c2d9" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35731 } } peers { permanent_uuid: "c40b3860816241f6bbb0f6499d61d398" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43537 } }
I20260929 06:41:59.418512 964 heartbeater.cc:503] Master 127.15.157.190:46147 was elected leader, sending a full tablet report...
I20260929 06:41:59.418776 978 ts_tablet_manager.cc:1428] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:41:59.419050 979 raft_consensus.cc:348] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2494ad8ce664d59a6191f059167288c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 43195 } } peers { permanent_uuid: "2f640295de344826b3ca8769c5c2c2d9" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35731 } } peers { permanent_uuid: "c40b3860816241f6bbb0f6499d61d398" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43537 } }
I20260929 06:41:59.419207 979 raft_consensus.cc:374] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:41:59.419252 979 raft_consensus.cc:729] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2494ad8ce664d59a6191f059167288c, State: Initialized, Role: FOLLOWER
I20260929 06:41:59.419358 979 consensus_queue.cc:260] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2494ad8ce664d59a6191f059167288c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 43195 } } peers { permanent_uuid: "2f640295de344826b3ca8769c5c2c2d9" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35731 } } peers { permanent_uuid: "c40b3860816241f6bbb0f6499d61d398" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43537 } }
I20260929 06:41:59.419659 979 ts_tablet_manager.cc:1428] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:41:59.419823 830 heartbeater.cc:503] Master 127.15.157.190:46147 was elected leader, sending a full tablet report...
I20260929 06:41:59.420117 981 raft_consensus.cc:348] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2494ad8ce664d59a6191f059167288c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 43195 } } peers { permanent_uuid: "2f640295de344826b3ca8769c5c2c2d9" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35731 } } peers { permanent_uuid: "c40b3860816241f6bbb0f6499d61d398" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43537 } }
I20260929 06:41:59.420315 981 raft_consensus.cc:374] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:41:59.420358 981 raft_consensus.cc:729] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c40b3860816241f6bbb0f6499d61d398, State: Initialized, Role: FOLLOWER
I20260929 06:41:59.420483 981 consensus_queue.cc:260] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2494ad8ce664d59a6191f059167288c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 43195 } } peers { permanent_uuid: "2f640295de344826b3ca8769c5c2c2d9" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35731 } } peers { permanent_uuid: "c40b3860816241f6bbb0f6499d61d398" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43537 } }
I20260929 06:41:59.420785 981 ts_tablet_manager.cc:1428] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:41:59.420785 696 heartbeater.cc:503] Master 127.15.157.190:46147 was elected leader, sending a full tablet report...
I20260929 06:41:59.469167 986 raft_consensus.cc:482] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:41:59.469292 986 raft_consensus.cc:504] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2494ad8ce664d59a6191f059167288c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 43195 } } peers { permanent_uuid: "2f640295de344826b3ca8769c5c2c2d9" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35731 } } peers { permanent_uuid: "c40b3860816241f6bbb0f6499d61d398" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43537 } }
I20260929 06:41:59.469748 986 leader_election.cc:288] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2494ad8ce664d59a6191f059167288c (127.15.157.130:43195), 2f640295de344826b3ca8769c5c2c2d9 (127.15.157.131:35731)
W20260929 06:41:59.472494 831 tablet.cc:2369] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:41:59.472621 974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.469961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:49321 (local address 127.15.157.130:43195)
0929 06:41:59.470008 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:59.470039 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:59.470050 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:41:59.470127 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:59.470129 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:59.470143 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:59.470222 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:59.470392 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.470910 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.471868 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.472267 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.472323 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.472330 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:59.472517 (+ 187us) server_negotiation.cc:299] Negotiation successful
0929 06:41:59.472560 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:41:59.472621 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.469911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:43195 (local address 127.15.157.129:49321)
0929 06:41:59.469965 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:59.469977 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:59.470035 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:59.470236 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:59.470237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:59.470238 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:59.470316 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.470318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.470988 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.470989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.471770 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.471772 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.472345 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.472346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.472428 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.472431 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:41:59.472509 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 06:41:59.472548 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":15}
I20260929 06:41:59.472656 975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.470048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:32799 (local address 127.15.157.131:35731)
0929 06:41:59.470089 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:59.470091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:59.470208 (+ 117us) server_negotiation.cc:407] Connection header received
0929 06:41:59.470244 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:59.470245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:59.470255 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:59.470326 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:41:59.470508 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.470974 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.471916 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.472282 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.472390 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.472399 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:59.472558 (+ 159us) server_negotiation.cc:299] Negotiation successful
0929 06:41:59.472598 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:41:59.472951 784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1602377276dc4c65bc4aafd7505c22c9" candidate_uuid: "c40b3860816241f6bbb0f6499d61d398" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2494ad8ce664d59a6191f059167288c" is_pre_election: true
I20260929 06:41:59.473014 987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.469924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:35731 (local address 127.15.157.129:32799)
0929 06:41:59.470127 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:59.470137 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:59.470199 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:59.470343 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:59.470344 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:59.470345 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:41:59.470435 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.470437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.471060 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.471061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.471799 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.471801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.472393 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.472393 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.472462 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.472465 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:41:59.472928 (+ 463us) client_negotiation.cc:240] Negotiation successful
0929 06:41:59.472963 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":142,"threads_started":1}
I20260929 06:41:59.473106 784 raft_consensus.cc:2454] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c40b3860816241f6bbb0f6499d61d398 in term 0.
I20260929 06:41:59.473383 918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1602377276dc4c65bc4aafd7505c22c9" candidate_uuid: "c40b3860816241f6bbb0f6499d61d398" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f640295de344826b3ca8769c5c2c2d9" is_pre_election: true
I20260929 06:41:59.473429 586 leader_election.cc:302] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2494ad8ce664d59a6191f059167288c, c40b3860816241f6bbb0f6499d61d398; no voters:
I20260929 06:41:59.473531 918 raft_consensus.cc:2454] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c40b3860816241f6bbb0f6499d61d398 in term 0.
I20260929 06:41:59.473592 986 raft_consensus.cc:2781] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:41:59.473668 986 raft_consensus.cc:482] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:41:59.473716 986 raft_consensus.cc:3037] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:41:59.474493 986 raft_consensus.cc:504] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2494ad8ce664d59a6191f059167288c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 43195 } } peers { permanent_uuid: "2f640295de344826b3ca8769c5c2c2d9" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35731 } } peers { permanent_uuid: "c40b3860816241f6bbb0f6499d61d398" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43537 } }
I20260929 06:41:59.474623 986 leader_election.cc:288] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [CANDIDATE]: Term 1 election: Requested vote from peers a2494ad8ce664d59a6191f059167288c (127.15.157.130:43195), 2f640295de344826b3ca8769c5c2c2d9 (127.15.157.131:35731)
I20260929 06:41:59.474799 918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1602377276dc4c65bc4aafd7505c22c9" candidate_uuid: "c40b3860816241f6bbb0f6499d61d398" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f640295de344826b3ca8769c5c2c2d9"
I20260929 06:41:59.474807 784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1602377276dc4c65bc4aafd7505c22c9" candidate_uuid: "c40b3860816241f6bbb0f6499d61d398" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2494ad8ce664d59a6191f059167288c"
I20260929 06:41:59.474867 784 raft_consensus.cc:3037] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:41:59.474890 918 raft_consensus.cc:3037] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:41:59.475546 784 raft_consensus.cc:2454] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c40b3860816241f6bbb0f6499d61d398 in term 1.
I20260929 06:41:59.475647 918 raft_consensus.cc:2454] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c40b3860816241f6bbb0f6499d61d398 in term 1.
I20260929 06:41:59.475710 586 leader_election.cc:302] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2494ad8ce664d59a6191f059167288c, c40b3860816241f6bbb0f6499d61d398; no voters:
I20260929 06:41:59.475790 986 raft_consensus.cc:2781] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:41:59.475968 986 raft_consensus.cc:686] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [term 1 LEADER]: Becoming Leader. State: Replica: c40b3860816241f6bbb0f6499d61d398, State: Running, Role: LEADER
I20260929 06:41:59.476063 986 consensus_queue.cc:237] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2494ad8ce664d59a6191f059167288c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 43195 } } peers { permanent_uuid: "2f640295de344826b3ca8769c5c2c2d9" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35731 } } peers { permanent_uuid: "c40b3860816241f6bbb0f6499d61d398" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43537 } }
I20260929 06:41:59.476900 505 catalog_manager.cc:5495] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 reported cstate change: term changed from 0 to 1, leader changed from <none> to c40b3860816241f6bbb0f6499d61d398 (127.15.157.129). New cstate: current_term: 1 leader_uuid: "c40b3860816241f6bbb0f6499d61d398" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2494ad8ce664d59a6191f059167288c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 43195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f640295de344826b3ca8769c5c2c2d9" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c40b3860816241f6bbb0f6499d61d398" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43537 } health_report { overall_health: HEALTHY } } }
I20260929 06:41:59.486233 977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.484084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40262 (local address 127.15.157.129:43537)
0929 06:41:59.484124 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:59.484126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:59.484142 (+ 16us) server_negotiation.cc:407] Connection header received
0929 06:41:59.484188 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:59.484188 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:59.484206 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:59.484263 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:41:59.484381 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.484832 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.485526 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.485707 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.485754 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.485878 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:41:59.485963 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:41:59.486066 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:59.486108 (+ 42us) server_negotiation.cc:299] Negotiation successful
0929 06:41:59.486125 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:41:59.487821 784 raft_consensus.cc:1261] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c [term 1 FOLLOWER]: Refusing update from remote peer c40b3860816241f6bbb0f6499d61d398: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:41:59.487855 918 raft_consensus.cc:1261] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9 [term 1 FOLLOWER]: Refusing update from remote peer c40b3860816241f6bbb0f6499d61d398: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:41:59.488198 988 consensus_queue.cc:1035] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f640295de344826b3ca8769c5c2c2d9" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:41:59.488344 986 consensus_queue.cc:1035] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2494ad8ce664d59a6191f059167288c" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 43195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:41:59.490329 991 mvcc.cc:205] Tried to move back new op lower bound from 7334560233419788288 to 7334560233374556160. Current Snapshot: MvccSnapshot[applied={T|T < 7334560233419788288}]
I20260929 06:41:59.493184 505 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:41:59.493278 505 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:41:59.494045 505 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d4188960ae7447e9b4006963024733af: Sending DeleteTablet for 3 replicas of tablet 1602377276dc4c65bc4aafd7505c22c9
I20260929 06:41:59.494387 764 tablet_service.cc:1514] Processing DeleteTablet for tablet 1602377276dc4c65bc4aafd7505c22c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:41:59 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:37912
I20260929 06:41:59.494450 630 tablet_service.cc:1514] Processing DeleteTablet for tablet 1602377276dc4c65bc4aafd7505c22c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:41:59 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:40260
I20260929 06:41:59.494468 898 tablet_service.cc:1514] Processing DeleteTablet for tablet 1602377276dc4c65bc4aafd7505c22c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:41:59 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:33372
I20260929 06:41:59.494688 1003 tablet_replica.cc:330] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398: stopping tablet replica
I20260929 06:41:59.494692 1001 tablet_replica.cc:330] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c: stopping tablet replica
I20260929 06:41:59.494798 1001 raft_consensus.cc:2229] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:41:59.494827 1002 tablet_replica.cc:330] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9: stopping tablet replica
I20260929 06:41:59.494921 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 567
I20260929 06:41:59.494947 1001 raft_consensus.cc:2258] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:41:59.495054 1003 raft_consensus.cc:2229] T 1602377276dc4c65bc4aafd7505c22c9 P c40b3860816241f6bbb0f6499d61d398 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:41:59.495167 1002 raft_consensus.cc:2229] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:41:59.495280 1002 raft_consensus.cc:2258] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:41:59.495353 1001 ts_tablet_manager.cc:1905] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:41:59.495886 1002 ts_tablet_manager.cc:1905] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:41:59.497610 1001 ts_tablet_manager.cc:1918] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:41:59.497653 1002 ts_tablet_manager.cc:1918] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:41:59.497687 1001 log.cc:1196] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/1602377276dc4c65bc4aafd7505c22c9
I20260929 06:41:59.497752 1002 log.cc:1196] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/1602377276dc4c65bc4aafd7505c22c9
I20260929 06:41:59.497991 1001 ts_tablet_manager.cc:1939] T 1602377276dc4c65bc4aafd7505c22c9 P a2494ad8ce664d59a6191f059167288c: Deleting consensus metadata
I20260929 06:41:59.498009 1002 ts_tablet_manager.cc:1939] T 1602377276dc4c65bc4aafd7505c22c9 P 2f640295de344826b3ca8769c5c2c2d9: Deleting consensus metadata
I20260929 06:41:59.498405 492 catalog_manager.cc:4841] TS a2494ad8ce664d59a6191f059167288c (127.15.157.130:43195): tablet 1602377276dc4c65bc4aafd7505c22c9 (table test-table [id=2ecd3ffc8d7d4da2b4db0c4e1deab05f]) successfully deleted
I20260929 06:41:59.498440 491 catalog_manager.cc:4841] TS 2f640295de344826b3ca8769c5c2c2d9 (127.15.157.131:35731): tablet 1602377276dc4c65bc4aafd7505c22c9 (table test-table [id=2ecd3ffc8d7d4da2b4db0c4e1deab05f]) successfully deleted
W20260929 06:41:59.501653 491 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:43537 (error 108)
I20260929 06:41:59.502177 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.502062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:43537 (local address 127.0.0.1:40270)
0929 06:41:59.502106 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:59.502146 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:43537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260929 06:41:59.502188 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 701
W20260929 06:41:59.502305 491 catalog_manager.cc:4584] TS c40b3860816241f6bbb0f6499d61d398 (127.15.157.129:43537): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1602377276dc4c65bc4aafd7505c22c9: Network error: Client connection negotiation failed: client connection to 127.15.157.129:43537: connect: Connection refused (error 111)
I20260929 06:41:59.507200 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 835
I20260929 06:41:59.512087 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 473
2026-09-29T06:41:59Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (1910 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-09-29T06:41:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:41:59Z Disabled control of system clock
I20260929 06:41:59.539019 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:38355
--webserver_interface=127.15.157.190
--webserver_port=0
--builtin_ntp_servers=127.15.157.148:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:38355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:41:59.618563 1008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:59.618782 1008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:59.618803 1008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:59.619877 1008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:41:59.619910 1008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:59.619921 1008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:59.619935 1008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:41:59.619946 1008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:41:59.621173 1008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:38355
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:38355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:59.621352 1008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:59.621570 1008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:59.626269 1013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:59.626303 1014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:59.626315 1016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:59.626447 1008 server_base.cc:1034] running on GCE node
I20260929 06:41:59.627008 1008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:59.627324 1008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:59.628470 1008 hybrid_clock.cc:648] HybridClock initialized: now 1790664119628450 us; error 36 us; skew 500 ppm
I20260929 06:41:59.629653 1008 webserver.cc:460] Webserver started at http://127.15.157.190:34325/ using document root <none> and password file <none>
I20260929 06:41:59.629904 1008 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:59.629952 1008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:59.630126 1008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:41:59.631204 1008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "c8de77fb4d4540859c101a252c1209db"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "a378106fd3c76008cc93ed6cd928b7bf"
server_key_iv: "d96eaf8185144edcf6adbe0da9eaf1b2"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.631558 1008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "c8de77fb4d4540859c101a252c1209db"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "a378106fd3c76008cc93ed6cd928b7bf"
server_key_iv: "d96eaf8185144edcf6adbe0da9eaf1b2"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.632885 1008 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:41:59.633574 1022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.633741 1008 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:41:59.633829 1008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "c8de77fb4d4540859c101a252c1209db"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "a378106fd3c76008cc93ed6cd928b7bf"
server_key_iv: "d96eaf8185144edcf6adbe0da9eaf1b2"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.633883 1008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:59.655555 1008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:59.655835 1008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:59.655938 1008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:59.659614 1008 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:38355
I20260929 06:41:59.659650 1074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:38355 every 8 connection(s)
I20260929 06:41:59.659999 1008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:41:59.660956 1075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:41:59.662880 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 1008
I20260929 06:41:59.663003 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:41:59.663189 15990 external_mini_cluster.cc:1428] Setting key 89523a45f9ed4a22e6b9c746f3029d95
I20260929 06:41:59.663347 1075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db: Bootstrap starting.
I20260929 06:41:59.664089 1075 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db: Neither blocks nor log segments found. Creating new log.
I20260929 06:41:59.664423 1075 log.cc:824] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db: Log is configured to *not* fsync() on all Append() calls
I20260929 06:41:59.665213 1075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db: No bootstrap required, opened a new log
I20260929 06:41:59.667503 1075 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8de77fb4d4540859c101a252c1209db" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38355 } }
I20260929 06:41:59.667667 1075 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:41:59.667699 1075 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8de77fb4d4540859c101a252c1209db, State: Initialized, Role: FOLLOWER
I20260929 06:41:59.667819 1075 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8de77fb4d4540859c101a252c1209db" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38355 } }
I20260929 06:41:59.667909 1075 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:41:59.667939 1075 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:41:59.668031 1075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:41:59.668577 1075 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8de77fb4d4540859c101a252c1209db" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38355 } }
I20260929 06:41:59.668684 1075 leader_election.cc:302] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8de77fb4d4540859c101a252c1209db; no voters:
I20260929 06:41:59.668843 1075 leader_election.cc:288] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:41:59.668876 1080 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:41:59.669028 1080 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [term 1 LEADER]: Becoming Leader. State: Replica: c8de77fb4d4540859c101a252c1209db, State: Running, Role: LEADER
I20260929 06:41:59.669113 1075 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:41:59.669162 1080 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8de77fb4d4540859c101a252c1209db" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38355 } }
I20260929 06:41:59.669515 1078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.663732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47804 (local address 127.15.157.190:38355)
0929 06:41:59.663945 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:59.663954 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:59.663989 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:41:59.664561 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:59.664571 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:59.664656 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:59.664794 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:59.665022 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.666402 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.667153 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.667783 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.667902 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.668598 (+ 696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:59.668602 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:59.668602 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:41:59.668826 (+ 224us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:59.668868 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:41:59.668884 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:59.669207 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:59.669240 (+ 33us) server_negotiation.cc:299] Negotiation successful
0929 06:41:59.669319 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260929 06:41:59.669544 1080 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8de77fb4d4540859c101a252c1209db. Latest consensus state: current_term: 1 leader_uuid: "c8de77fb4d4540859c101a252c1209db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8de77fb4d4540859c101a252c1209db" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38355 } } }
I20260929 06:41:59.669557 1082 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8de77fb4d4540859c101a252c1209db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8de77fb4d4540859c101a252c1209db" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 38355 } } }
I20260929 06:41:59.669828 1080 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [sys.catalog]: This master's current role is: LEADER
I20260929 06:41:59.669837 1082 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db [sys.catalog]: This master's current role is: LEADER
I20260929 06:41:59.670554 1089 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:41:59.671149 1089 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:41:59.672487 1089 catalog_manager.cc:1347] Generated new cluster ID: cead05016ff14339a5c07a56977d94e9
I20260929 06:41:59.672557 1089 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:41:59.677383 1089 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:41:59.677889 1089 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:41:59.680644 1089 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db: Generated new TSK 0
I20260929 06:41:59.680799 1089 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:41:59.685105 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38355
--builtin_ntp_servers=127.15.157.148:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:41:59.765491 1099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:59.765686 1099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:59.765715 1099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:59.766927 1099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:59.766968 1099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:59.766992 1099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:41:59.768324 1099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:59.768555 1099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:59.768922 1099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:59.774119 1105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:59.774241 1104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:59.774127 1107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:59.774555 1099 server_base.cc:1034] running on GCE node
I20260929 06:41:59.774771 1099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:59.775036 1099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:59.776186 1099 hybrid_clock.cc:648] HybridClock initialized: now 1790664119776177 us; error 26 us; skew 500 ppm
I20260929 06:41:59.777462 1099 webserver.cc:460] Webserver started at http://127.15.157.129:41037/ using document root <none> and password file <none>
I20260929 06:41:59.777750 1099 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:59.777798 1099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:59.777923 1099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:41:59.779026 1099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "ebea62f7a42616bd175985ea2935094c"
server_key_iv: "3a6464dcb145b502b6020cf2c07f413c"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.779377 1099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "ebea62f7a42616bd175985ea2935094c"
server_key_iv: "3a6464dcb145b502b6020cf2c07f413c"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.780690 1099 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:41:59.781456 1113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.781682 1099 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:41:59.781780 1099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "ebea62f7a42616bd175985ea2935094c"
server_key_iv: "3a6464dcb145b502b6020cf2c07f413c"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.781850 1099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:59.797803 1099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:59.798139 1099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:59.798285 1099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:59.798507 1099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:41:59.798841 1099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:41:59.798882 1099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.798910 1099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:41:59.798933 1099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.805028 1099 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:42957
I20260929 06:41:59.805140 1226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:42957 every 8 connection(s)
I20260929 06:41:59.805462 1099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:41:59.809921 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 1099
I20260929 06:41:59.810060 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:41:59.810288 15990 external_mini_cluster.cc:1428] Setting key c1c048dd8e0c3c973d73afc0031f2366
I20260929 06:41:59.810683 1078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.806306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:56787 (local address 127.15.157.190:38355)
0929 06:41:59.806373 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:59.806375 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:59.806579 (+ 204us) server_negotiation.cc:407] Connection header received
0929 06:41:59.807064 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:59.807065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:59.807075 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:59.807123 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:59.807777 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.808258 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.809203 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.809382 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.809431 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.810443 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:59.810444 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:59.810445 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:41:59.810450 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:59.810464 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:41:59.810468 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:59.810512 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:59.810601 (+ 89us) server_negotiation.cc:299] Negotiation successful
0929 06:41:59.810625 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 06:41:59.811146 1229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.806294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38355 (local address 127.15.157.129:56787)
0929 06:41:59.806469 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:59.806504 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:59.806973 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:59.807184 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:59.807187 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:59.807201 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:41:59.807692 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.807697 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.808343 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.808344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.809120 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.809122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.809456 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.809457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.809568 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.810270 (+ 702us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:41:59.810271 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:41:59.810311 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:41:59.810360 (+ 49us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:41:59.810523 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:41:59.810528 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:41:59.810531 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:41:59.810600 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 06:41:59.810978 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
I20260929 06:41:59.811322 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38355
--builtin_ntp_servers=127.15.157.148:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260929 06:41:59.811647 1227 heartbeater.cc:347] Connected to a master server at 127.15.157.190:38355
I20260929 06:41:59.811767 1227 heartbeater.cc:464] Registering TS with master...
I20260929 06:41:59.811949 1227 heartbeater.cc:511] Master 127.15.157.190:38355 requested a full tablet report, sending...
I20260929 06:41:59.812525 1039 ts_manager.cc:194] Registered new tserver with Master: 6016b3e29cab4aa58a3e99c4bc2fc57c (127.15.157.129:42957)
I20260929 06:41:59.813177 1039 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.157.129:56787
W20260929 06:41:59.892640 1230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:41:59.892833 1230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:41:59.892854 1230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:41:59.894059 1230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:41:59.894099 1230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:41:59.894124 1230 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:41:59.895517 1230 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:41:59.895743 1230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:41:59.896028 1230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:41:59.901000 1238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:59.901013 1236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:41:59.901080 1235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:41:59.901249 1230 server_base.cc:1034] running on GCE node
I20260929 06:41:59.901463 1230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:41:59.901681 1230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:41:59.902842 1230 hybrid_clock.cc:648] HybridClock initialized: now 1790664119902817 us; error 43 us; skew 500 ppm
I20260929 06:41:59.904136 1230 webserver.cc:460] Webserver started at http://127.15.157.130:35431/ using document root <none> and password file <none>
I20260929 06:41:59.904418 1230 fs_manager.cc:359] Metadata directory not provided
I20260929 06:41:59.904495 1230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:41:59.904645 1230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:41:59.905690 1230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "5548ec5d0ffd4e5493716acd4651bdb5"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "1f8e87a9a0f540828d682ba9c2e5582f"
server_key_iv: "8db933f76f7519959b6b1a6e90e4af26"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.906121 1230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "5548ec5d0ffd4e5493716acd4651bdb5"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "1f8e87a9a0f540828d682ba9c2e5582f"
server_key_iv: "8db933f76f7519959b6b1a6e90e4af26"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.907413 1230 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:41:59.908100 1244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.908280 1230 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:41:59.908378 1230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "5548ec5d0ffd4e5493716acd4651bdb5"
format_stamp: "Formatted at 2026-09-29 06:41:59 on dist-test-slave-ltw5"
server_key: "1f8e87a9a0f540828d682ba9c2e5582f"
server_key_iv: "8db933f76f7519959b6b1a6e90e4af26"
server_key_version: "encryptionkey@0"
I20260929 06:41:59.908460 1230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:41:59.941591 1230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:41:59.942088 1230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:41:59.942250 1230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:41:59.942544 1230 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:41:59.942979 1230 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:41:59.943043 1230 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.943084 1230 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:41:59.943141 1230 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:41:59.949086 1230 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:39697
I20260929 06:41:59.949127 1357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:39697 every 8 connection(s)
I20260929 06:41:59.949469 1230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:41:59.954366 1078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.950211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:33511 (local address 127.15.157.190:38355)
0929 06:41:59.950278 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 06:41:59.950280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:41:59.950508 (+ 228us) server_negotiation.cc:407] Connection header received
0929 06:41:59.950999 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:41:59.951000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:41:59.951010 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:41:59.951062 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:41:59.951709 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.952188 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.953101 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.953286 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.953336 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.954134 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:41:59.954135 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:41:59.954136 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:41:59.954140 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:41:59.954152 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:41:59.954156 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:41:59.954198 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 06:41:59.954286 (+ 88us) server_negotiation.cc:299] Negotiation successful
0929 06:41:59.954306 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 06:41:59.954588 1360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:41:59.950225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38355 (local address 127.15.157.130:33511)
0929 06:41:59.950406 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0929 06:41:59.950439 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 06:41:59.950906 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:41:59.951114 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:41:59.951117 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:41:59.951125 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:41:59.951637 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.951641 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.952263 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.952264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.953027 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:41:59.953029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:41:59.953354 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:41:59.953354 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:41:59.953460 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:41:59.953957 (+ 497us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:41:59.953958 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:41:59.953984 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:41:59.954006 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:41:59.954211 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:41:59.954215 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:41:59.954217 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:41:59.954270 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 06:41:59.954347 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":97,"threads_started":1}
I20260929 06:41:59.955084 1358 heartbeater.cc:347] Connected to a master server at 127.15.157.190:38355
I20260929 06:41:59.955200 1358 heartbeater.cc:464] Registering TS with master...
I20260929 06:41:59.955371 1358 heartbeater.cc:511] Master 127.15.157.190:38355 requested a full tablet report, sending...
I20260929 06:41:59.955776 1039 ts_manager.cc:194] Registered new tserver with Master: 5548ec5d0ffd4e5493716acd4651bdb5 (127.15.157.130:39697)
I20260929 06:41:59.956135 1039 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.157.130:33511
I20260929 06:41:59.956746 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 1230
I20260929 06:41:59.956838 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:41:59.956971 15990 external_mini_cluster.cc:1428] Setting key 35a4ad838adf6aa8a7420183e8cf7205
I20260929 06:41:59.957734 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38355
--builtin_ntp_servers=127.15.157.148:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:42:00.039779 1361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:00.039997 1361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:00.040019 1361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:00.041113 1361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:00.041148 1361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:00.041173 1361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:42:00.042598 1361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:38355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:00.042794 1361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:00.043044 1361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:00.048007 1366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:00.048026 1369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:00.048206 1361 server_base.cc:1034] running on GCE node
W20260929 06:42:00.048053 1367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:00.048514 1361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:00.048763 1361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:00.049930 1361 hybrid_clock.cc:648] HybridClock initialized: now 1790664120049896 us; error 48 us; skew 500 ppm
I20260929 06:42:00.051278 1361 webserver.cc:460] Webserver started at http://127.15.157.131:40813/ using document root <none> and password file <none>
I20260929 06:42:00.051537 1361 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:00.051607 1361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:00.051753 1361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:00.052865 1361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "b15656a88e0c4bd6a2822ef2580153b0"
format_stamp: "Formatted at 2026-09-29 06:42:00 on dist-test-slave-ltw5"
server_key: "5af20d9db7006d5d946e475b4ac634d8"
server_key_iv: "289fc51b159f7352cf87d2ef8d9a9a00"
server_key_version: "encryptionkey@0"
I20260929 06:42:00.053231 1361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "b15656a88e0c4bd6a2822ef2580153b0"
format_stamp: "Formatted at 2026-09-29 06:42:00 on dist-test-slave-ltw5"
server_key: "5af20d9db7006d5d946e475b4ac634d8"
server_key_iv: "289fc51b159f7352cf87d2ef8d9a9a00"
server_key_version: "encryptionkey@0"
I20260929 06:42:00.054646 1361 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:42:00.055353 1375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:00.055526 1361 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:42:00.055624 1361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "b15656a88e0c4bd6a2822ef2580153b0"
format_stamp: "Formatted at 2026-09-29 06:42:00 on dist-test-slave-ltw5"
server_key: "5af20d9db7006d5d946e475b4ac634d8"
server_key_iv: "289fc51b159f7352cf87d2ef8d9a9a00"
server_key_version: "encryptionkey@0"
I20260929 06:42:00.055711 1361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:00.070574 1361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:00.070897 1361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:00.071060 1361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:00.071305 1361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:42:00.071630 1361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:42:00.071686 1361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:00.071731 1361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:42:00.071753 1361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:00.077672 1361 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:34659
I20260929 06:42:00.077725 1488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:34659 every 8 connection(s)
I20260929 06:42:00.078073 1361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:42:00.082499 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 1361
I20260929 06:42:00.082615 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:42:00.082885 15990 external_mini_cluster.cc:1428] Setting key 70d827b79d2a4777be446d7160ec1ef2
I20260929 06:42:00.083693 1078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.078798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:53209 (local address 127.15.157.190:38355)
0929 06:42:00.078871 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:00.078873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:00.079153 (+ 280us) server_negotiation.cc:407] Connection header received
0929 06:42:00.079700 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:00.079702 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:00.079716 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:00.079769 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:00.080471 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.080991 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.082067 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.082260 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.082344 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:00.083361 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:00.083362 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:00.083362 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:00.083366 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:00.083381 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:00.083385 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:00.083448 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:00.083567 (+ 119us) server_negotiation.cc:299] Negotiation successful
0929 06:42:00.083596 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260929 06:42:00.083912 1491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.078771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:38355 (local address 127.15.157.131:53209)
0929 06:42:00.079013 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:00.079057 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:00.079579 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:00.079844 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:00.079848 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:00.079858 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:00.080360 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:00.080364 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.081095 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.081096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:00.081905 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:00.081908 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.082362 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.082363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:00.082502 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:00.083191 (+ 689us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:42:00.083192 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:00.083232 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:42:00.083259 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:00.083452 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:00.083456 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:00.083459 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:42:00.083544 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 06:42:00.083678 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":96,"threads_started":1}
I20260929 06:42:00.084337 1489 heartbeater.cc:347] Connected to a master server at 127.15.157.190:38355
I20260929 06:42:00.084439 1489 heartbeater.cc:464] Registering TS with master...
I20260929 06:42:00.084578 1489 heartbeater.cc:511] Master 127.15.157.190:38355 requested a full tablet report, sending...
I20260929 06:42:00.084910 1039 ts_manager.cc:194] Registered new tserver with Master: b15656a88e0c4bd6a2822ef2580153b0 (127.15.157.131:34659)
I20260929 06:42:00.085314 1039 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.157.131:53209
I20260929 06:42:00.094866 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:42:00.099457 1078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.096293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47816 (local address 127.15.157.190:38355)
0929 06:42:00.096403 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:00.096405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:00.096510 (+ 105us) server_negotiation.cc:407] Connection header received
0929 06:42:00.096579 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:00.096580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:00.096592 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:00.096696 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:00.096885 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.097390 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.098255 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.098448 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.098526 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:00.099184 (+ 658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:00.099185 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:00.099186 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:00.099190 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:00.099205 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:00.099214 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:00.099276 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:00.099338 (+ 62us) server_negotiation.cc:299] Negotiation successful
0929 06:42:00.099360 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260929 06:42:00.101176 1039 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47816:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:42:00.102914 1039 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:42:00.109383 1498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.105168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:42957 (local address 127.0.0.1:55080)
0929 06:42:00.105440 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:00.105470 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:00.105530 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:00.105943 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:00.105945 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:00.105947 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:00.106011 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:00.106031 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.107034 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.107035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:00.108295 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:00.108298 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.109090 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.109091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:00.109172 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:00.109186 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 06:42:00.109258 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 06:42:00.109307 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":90,"threads_started":1}
I20260929 06:42:00.109395 1502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.105607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55080 (local address 127.15.157.129:42957)
0929 06:42:00.105780 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:00.105784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:00.105792 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:42:00.105824 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:00.105826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:00.105837 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:00.105939 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:00.106160 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.106943 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.108389 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.109002 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.109093 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:00.109187 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:00.109269 (+ 82us) server_negotiation.cc:299] Negotiation successful
0929 06:42:00.109308 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":87,"threads_started":1}
I20260929 06:42:00.109663 1497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.105162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:39697 (local address 127.0.0.1:44970)
0929 06:42:00.105420 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:00.105461 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:00.105529 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:00.106114 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:00.106115 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:00.106116 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:00.106156 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:00.106157 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.107501 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.107502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:00.108398 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:00.108401 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.109404 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.109406 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:00.109475 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:00.109479 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:42:00.109526 (+ 47us) client_negotiation.cc:240] Negotiation successful
0929 06:42:00.109570 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":27,"thread_start_us":77,"threads_started":1}
I20260929 06:42:00.109663 1499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.105171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:34659 (local address 127.0.0.1:48012)
0929 06:42:00.105440 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:00.105470 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:00.105530 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:00.106241 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:00.106242 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:00.106244 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:00.106285 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:00.106286 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.107489 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.107490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:00.108617 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:00.108619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.109477 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.109478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:00.109537 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:00.109540 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:42:00.109567 (+ 27us) client_negotiation.cc:240] Negotiation successful
0929 06:42:00.109594 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":45,"thread_start_us":88,"threads_started":1}
I20260929 06:42:00.109968 1500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.105239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44970 (local address 127.15.157.130:39697)
0929 06:42:00.105767 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:00.105771 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:00.105781 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:42:00.105839 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:00.105841 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:00.105857 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:00.105942 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:00.106244 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.107398 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.108486 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.109207 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.109284 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:00.109365 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:00.109843 (+ 478us) server_negotiation.cc:299] Negotiation successful
0929 06:42:00.109891 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":86,"threads_started":1}
I20260929 06:42:00.109968 1501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.105426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48012 (local address 127.15.157.131:34659)
0929 06:42:00.106078 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:00.106083 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:00.106093 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:42:00.106130 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:00.106132 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:00.106148 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:00.106230 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:00.106341 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.107398 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.108709 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.109389 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.109722 (+ 333us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:00.109821 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:00.109845 (+ 24us) server_negotiation.cc:299] Negotiation successful
0929 06:42:00.109883 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":84,"threads_started":1}
I20260929 06:42:00.110337 1161 tablet_service.cc:1467] Processing CreateTablet for tablet b71d3cf10b9345e08adb8d0f0fdc9aa5 (DEFAULT_TABLE table=test-table [id=cb697f5697f04ee693af4b34e26bede2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:00.110556 1292 tablet_service.cc:1467] Processing CreateTablet for tablet b71d3cf10b9345e08adb8d0f0fdc9aa5 (DEFAULT_TABLE table=test-table [id=cb697f5697f04ee693af4b34e26bede2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:00.110772 1161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b71d3cf10b9345e08adb8d0f0fdc9aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:00.110965 1292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b71d3cf10b9345e08adb8d0f0fdc9aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:00.113684 1503 tablet_bootstrap.cc:492] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5: Bootstrap starting.
I20260929 06:42:00.114421 1503 tablet_bootstrap.cc:654] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:00.114399 1504 tablet_bootstrap.cc:492] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c: Bootstrap starting.
I20260929 06:42:00.114403 1423 tablet_service.cc:1467] Processing CreateTablet for tablet b71d3cf10b9345e08adb8d0f0fdc9aa5 (DEFAULT_TABLE table=test-table [id=cb697f5697f04ee693af4b34e26bede2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:00.114702 1423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b71d3cf10b9345e08adb8d0f0fdc9aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:00.114811 1503 log.cc:824] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:00.115051 1504 tablet_bootstrap.cc:654] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:00.115330 1504 log.cc:824] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:00.115603 1503 tablet_bootstrap.cc:492] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5: No bootstrap required, opened a new log
I20260929 06:42:00.115649 1503 ts_tablet_manager.cc:1397] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 06:42:00.116101 1504 tablet_bootstrap.cc:492] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c: No bootstrap required, opened a new log
I20260929 06:42:00.116160 1504 ts_tablet_manager.cc:1397] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:42:00.117543 1507 tablet_bootstrap.cc:492] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0: Bootstrap starting.
I20260929 06:42:00.118142 1507 tablet_bootstrap.cc:654] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:00.118429 1507 log.cc:824] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:00.118386 1503 raft_consensus.cc:348] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42957 } } peers { permanent_uuid: "5548ec5d0ffd4e5493716acd4651bdb5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39697 } } peers { permanent_uuid: "b15656a88e0c4bd6a2822ef2580153b0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34659 } }
I20260929 06:42:00.118564 1503 raft_consensus.cc:374] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:00.118640 1503 raft_consensus.cc:729] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5548ec5d0ffd4e5493716acd4651bdb5, State: Initialized, Role: FOLLOWER
I20260929 06:42:00.118783 1503 consensus_queue.cc:260] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42957 } } peers { permanent_uuid: "5548ec5d0ffd4e5493716acd4651bdb5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39697 } } peers { permanent_uuid: "b15656a88e0c4bd6a2822ef2580153b0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34659 } }
I20260929 06:42:00.118813 1504 raft_consensus.cc:348] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42957 } } peers { permanent_uuid: "5548ec5d0ffd4e5493716acd4651bdb5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39697 } } peers { permanent_uuid: "b15656a88e0c4bd6a2822ef2580153b0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34659 } }
I20260929 06:42:00.118970 1504 raft_consensus.cc:374] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:00.119017 1504 raft_consensus.cc:729] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6016b3e29cab4aa58a3e99c4bc2fc57c, State: Initialized, Role: FOLLOWER
I20260929 06:42:00.119058 1503 ts_tablet_manager.cc:1428] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260929 06:42:00.119108 1358 heartbeater.cc:503] Master 127.15.157.190:38355 was elected leader, sending a full tablet report...
I20260929 06:42:00.119166 1504 consensus_queue.cc:260] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42957 } } peers { permanent_uuid: "5548ec5d0ffd4e5493716acd4651bdb5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39697 } } peers { permanent_uuid: "b15656a88e0c4bd6a2822ef2580153b0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34659 } }
I20260929 06:42:00.119423 1504 ts_tablet_manager.cc:1428] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 06:42:00.119446 1227 heartbeater.cc:503] Master 127.15.157.190:38355 was elected leader, sending a full tablet report...
I20260929 06:42:00.120064 1507 tablet_bootstrap.cc:492] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0: No bootstrap required, opened a new log
I20260929 06:42:00.120180 1507 ts_tablet_manager.cc:1397] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260929 06:42:00.122241 1507 raft_consensus.cc:348] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42957 } } peers { permanent_uuid: "5548ec5d0ffd4e5493716acd4651bdb5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39697 } } peers { permanent_uuid: "b15656a88e0c4bd6a2822ef2580153b0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34659 } }
I20260929 06:42:00.122364 1507 raft_consensus.cc:374] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:00.122385 1507 raft_consensus.cc:729] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b15656a88e0c4bd6a2822ef2580153b0, State: Initialized, Role: FOLLOWER
I20260929 06:42:00.122521 1507 consensus_queue.cc:260] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42957 } } peers { permanent_uuid: "5548ec5d0ffd4e5493716acd4651bdb5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39697 } } peers { permanent_uuid: "b15656a88e0c4bd6a2822ef2580153b0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34659 } }
I20260929 06:42:00.122761 1507 ts_tablet_manager.cc:1428] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 06:42:00.122833 1489 heartbeater.cc:503] Master 127.15.157.190:38355 was elected leader, sending a full tablet report...
W20260929 06:42:00.200011 1359 tablet.cc:2369] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:42:00.306226 1228 tablet.cc:2369] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:42:00.328630 1490 tablet.cc:2369] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:42:00.349748 1511 raft_consensus.cc:482] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:42:00.349872 1511 raft_consensus.cc:504] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42957 } } peers { permanent_uuid: "5548ec5d0ffd4e5493716acd4651bdb5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39697 } } peers { permanent_uuid: "b15656a88e0c4bd6a2822ef2580153b0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34659 } }
I20260929 06:42:00.350427 1511 leader_election.cc:288] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6016b3e29cab4aa58a3e99c4bc2fc57c (127.15.157.129:42957), 5548ec5d0ffd4e5493716acd4651bdb5 (127.15.157.130:39697)
I20260929 06:42:00.353343 1491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.350639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:42957 (local address 127.15.157.131:34081)
0929 06:42:00.350709 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:00.350723 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:00.350789 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:00.350992 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:00.350993 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:00.350995 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:00.351076 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:00.351078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.351748 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.351750 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:00.352538 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:00.352540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.353065 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.353066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:00.353147 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:00.353150 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:42:00.353205 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 06:42:00.353254 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260929 06:42:00.353340 1502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.350765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:34081 (local address 127.15.157.129:42957)
0929 06:42:00.350833 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:00.350835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:00.350846 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:42:00.350881 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:00.350883 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:00.350894 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:00.350959 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:00.351164 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.351664 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.352627 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.352983 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.353037 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:00.353043 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:00.353219 (+ 176us) server_negotiation.cc:299] Negotiation successful
0929 06:42:00.353261 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 06:42:00.353410 1500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.350743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:44235 (local address 127.15.157.130:39697)
0929 06:42:00.350834 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:00.350836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:00.350972 (+ 136us) server_negotiation.cc:407] Connection header received
0929 06:42:00.351000 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:00.351001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:00.351013 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:00.351073 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:00.351254 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.351756 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.352672 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.353031 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.353101 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:00.353107 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:00.353285 (+ 178us) server_negotiation.cc:299] Negotiation successful
0929 06:42:00.353330 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260929 06:42:00.353456 1512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.350640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:39697 (local address 127.15.157.131:44235)
0929 06:42:00.350878 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:00.350887 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:00.350949 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:00.351087 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:00.351088 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:00.351089 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:00.351179 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:00.351181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.351842 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.351843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:00.352555 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:00.352556 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.353116 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.353117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:00.353201 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:00.353205 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:42:00.353262 (+ 57us) client_negotiation.cc:240] Negotiation successful
0929 06:42:00.353303 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":73,"thread_start_us":92,"threads_started":1}
I20260929 06:42:00.353789 1312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b71d3cf10b9345e08adb8d0f0fdc9aa5" candidate_uuid: "b15656a88e0c4bd6a2822ef2580153b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5548ec5d0ffd4e5493716acd4651bdb5" is_pre_election: true
I20260929 06:42:00.353845 1181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b71d3cf10b9345e08adb8d0f0fdc9aa5" candidate_uuid: "b15656a88e0c4bd6a2822ef2580153b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c" is_pre_election: true
I20260929 06:42:00.353955 1312 raft_consensus.cc:2454] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b15656a88e0c4bd6a2822ef2580153b0 in term 0.
I20260929 06:42:00.353999 1181 raft_consensus.cc:2454] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b15656a88e0c4bd6a2822ef2580153b0 in term 0.
I20260929 06:42:00.354199 1377 leader_election.cc:302] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5548ec5d0ffd4e5493716acd4651bdb5, b15656a88e0c4bd6a2822ef2580153b0; no voters:
I20260929 06:42:00.354338 1511 raft_consensus.cc:2781] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:42:00.354393 1511 raft_consensus.cc:482] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:42:00.354416 1511 raft_consensus.cc:3037] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:00.355103 1511 raft_consensus.cc:504] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42957 } } peers { permanent_uuid: "5548ec5d0ffd4e5493716acd4651bdb5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39697 } } peers { permanent_uuid: "b15656a88e0c4bd6a2822ef2580153b0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34659 } }
I20260929 06:42:00.355237 1511 leader_election.cc:288] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [CANDIDATE]: Term 1 election: Requested vote from peers 6016b3e29cab4aa58a3e99c4bc2fc57c (127.15.157.129:42957), 5548ec5d0ffd4e5493716acd4651bdb5 (127.15.157.130:39697)
I20260929 06:42:00.355372 1312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b71d3cf10b9345e08adb8d0f0fdc9aa5" candidate_uuid: "b15656a88e0c4bd6a2822ef2580153b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5548ec5d0ffd4e5493716acd4651bdb5"
I20260929 06:42:00.355384 1181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b71d3cf10b9345e08adb8d0f0fdc9aa5" candidate_uuid: "b15656a88e0c4bd6a2822ef2580153b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c"
I20260929 06:42:00.355455 1181 raft_consensus.cc:3037] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:00.355449 1312 raft_consensus.cc:3037] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:00.356161 1312 raft_consensus.cc:2454] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b15656a88e0c4bd6a2822ef2580153b0 in term 1.
I20260929 06:42:00.356222 1181 raft_consensus.cc:2454] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b15656a88e0c4bd6a2822ef2580153b0 in term 1.
I20260929 06:42:00.356321 1377 leader_election.cc:302] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5548ec5d0ffd4e5493716acd4651bdb5, b15656a88e0c4bd6a2822ef2580153b0; no voters:
I20260929 06:42:00.356416 1511 raft_consensus.cc:2781] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:00.356580 1511 raft_consensus.cc:686] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [term 1 LEADER]: Becoming Leader. State: Replica: b15656a88e0c4bd6a2822ef2580153b0, State: Running, Role: LEADER
I20260929 06:42:00.356696 1511 consensus_queue.cc:237] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42957 } } peers { permanent_uuid: "5548ec5d0ffd4e5493716acd4651bdb5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39697 } } peers { permanent_uuid: "b15656a88e0c4bd6a2822ef2580153b0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34659 } }
I20260929 06:42:00.357499 1039 catalog_manager.cc:5495] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b15656a88e0c4bd6a2822ef2580153b0 (127.15.157.131). New cstate: current_term: 1 leader_uuid: "b15656a88e0c4bd6a2822ef2580153b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5548ec5d0ffd4e5493716acd4651bdb5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b15656a88e0c4bd6a2822ef2580153b0" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 34659 } health_report { overall_health: HEALTHY } } }
I20260929 06:42:00.391736 1501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.389459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48014 (local address 127.15.157.131:34659)
0929 06:42:00.389520 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:00.389522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:00.389530 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:42:00.389566 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:00.389567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:00.389584 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:00.389689 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:00.389798 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.390289 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.391009 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:00.391203 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:00.391263 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:00.391398 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:00.391511 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:00.391574 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:00.391609 (+ 35us) server_negotiation.cc:299] Negotiation successful
0929 06:42:00.391657 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260929 06:42:00.393661 1312 raft_consensus.cc:1261] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5 [term 1 FOLLOWER]: Refusing update from remote peer b15656a88e0c4bd6a2822ef2580153b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:42:00.393746 1181 raft_consensus.cc:1261] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c [term 1 FOLLOWER]: Refusing update from remote peer b15656a88e0c4bd6a2822ef2580153b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:42:00.394059 1513 consensus_queue.cc:1035] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5548ec5d0ffd4e5493716acd4651bdb5" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 39697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:42:00.394202 1511 consensus_queue.cc:1035] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6016b3e29cab4aa58a3e99c4bc2fc57c" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:42:00.396642 1516 mvcc.cc:205] Tried to move back new op lower bound from 7334560237129498624 to 7334560236981628928. Current Snapshot: MvccSnapshot[applied={T|T < 7334560237129498624}]
I20260929 06:42:00.396910 1518 mvcc.cc:205] Tried to move back new op lower bound from 7334560237129498624 to 7334560236981628928. Current Snapshot: MvccSnapshot[applied={T|T < 7334560237129498624}]
I20260929 06:42:00.399183 1039 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:42:00.399286 1039 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:42:00.400045 1039 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c8de77fb4d4540859c101a252c1209db: Sending DeleteTablet for 3 replicas of tablet b71d3cf10b9345e08adb8d0f0fdc9aa5
I20260929 06:42:00.400406 1161 tablet_service.cc:1514] Processing DeleteTablet for tablet b71d3cf10b9345e08adb8d0f0fdc9aa5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:00 UTC) from {username='slave'} at 127.0.0.1:55080
I20260929 06:42:00.400403 1292 tablet_service.cc:1514] Processing DeleteTablet for tablet b71d3cf10b9345e08adb8d0f0fdc9aa5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:00 UTC) from {username='slave'} at 127.0.0.1:44970
I20260929 06:42:00.400617 1423 tablet_service.cc:1514] Processing DeleteTablet for tablet b71d3cf10b9345e08adb8d0f0fdc9aa5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:00 UTC) from {username='slave'} at 127.0.0.1:48012
I20260929 06:42:00.400849 1527 tablet_replica.cc:330] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0: stopping tablet replica
I20260929 06:42:00.400868 1525 tablet_replica.cc:330] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c: stopping tablet replica
I20260929 06:42:00.400959 1525 raft_consensus.cc:2229] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:42:00.400957 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 1099
I20260929 06:42:00.401073 1525 raft_consensus.cc:2258] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 6016b3e29cab4aa58a3e99c4bc2fc57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:42:00.401211 1526 tablet_replica.cc:330] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5: stopping tablet replica
I20260929 06:42:00.401275 1526 raft_consensus.cc:2229] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:42:00.401338 1526 raft_consensus.cc:2258] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:42:00.402334 1526 ts_tablet_manager.cc:1905] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:42:00.401050 1527 raft_consensus.cc:2229] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:42:00.402835 1527 raft_consensus.cc:2258] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:42:00.403301 1527 ts_tablet_manager.cc:1905] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:42:00.404130 1526 ts_tablet_manager.cc:1918] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:42:00.404258 1526 log.cc:1196] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/b71d3cf10b9345e08adb8d0f0fdc9aa5
I20260929 06:42:00.404569 1526 ts_tablet_manager.cc:1939] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P 5548ec5d0ffd4e5493716acd4651bdb5: Deleting consensus metadata
I20260929 06:42:00.405045 1024 catalog_manager.cc:4841] TS 5548ec5d0ffd4e5493716acd4651bdb5 (127.15.157.130:39697): tablet b71d3cf10b9345e08adb8d0f0fdc9aa5 (table test-table [id=cb697f5697f04ee693af4b34e26bede2]) successfully deleted
I20260929 06:42:00.405078 1527 ts_tablet_manager.cc:1918] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:42:00.405138 1527 log.cc:1196] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/b71d3cf10b9345e08adb8d0f0fdc9aa5
I20260929 06:42:00.405402 1527 ts_tablet_manager.cc:1939] T b71d3cf10b9345e08adb8d0f0fdc9aa5 P b15656a88e0c4bd6a2822ef2580153b0: Deleting consensus metadata
I20260929 06:42:00.405790 1023 catalog_manager.cc:4841] TS b15656a88e0c4bd6a2822ef2580153b0 (127.15.157.131:34659): tablet b71d3cf10b9345e08adb8d0f0fdc9aa5 (table test-table [id=cb697f5697f04ee693af4b34e26bede2]) successfully deleted
W20260929 06:42:00.408165 1026 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:42957 (error 108)
I20260929 06:42:00.408346 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 1230
I20260929 06:42:00.408946 1497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:00.408467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:42957 (local address 127.0.0.1:55092)
0929 06:42:00.408866 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:00.408906 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:42957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377}
W20260929 06:42:00.410089 1026 catalog_manager.cc:4584] TS 6016b3e29cab4aa58a3e99c4bc2fc57c (127.15.157.129:42957): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b71d3cf10b9345e08adb8d0f0fdc9aa5: Network error: Client connection negotiation failed: client connection to 127.15.157.129:42957: connect: Connection refused (error 111)
I20260929 06:42:00.413492 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 1361
I20260929 06:42:00.418288 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 1008
2026-09-29T06:42:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (905 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:00 dist-test-slave-ltw5 krb5kdc[1531](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:00 dist-test-slave-ltw5 krb5kdc[1531](info): set up 2 sockets
Sep 29 06:42:00 dist-test-slave-ltw5 krb5kdc[1531](info): commencing operation
krb5kdc: starting...
W20260929 06:42:01.445955 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.008s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:01 dist-test-slave-ltw5 krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664121, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:42:01.564188 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:34445
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:45059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:34445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:01.644282 1544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:01.644550 1544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:01.644587 1544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:01.645792 1544 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:01.645872 1544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:01.645895 1544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:01.645915 1544 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:01.645941 1544 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:01.647543 1544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:45059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:34445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:34445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:01.647842 1544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:01.648092 1544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:01.653030 1550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:01.652997 1552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:01.652997 1549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:01.653286 1544 server_base.cc:1034] running on GCE node
I20260929 06:42:01.653522 1544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:01.653846 1544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:01.655016 1544 hybrid_clock.cc:648] HybridClock initialized: now 1790664121654996 us; error 40 us; skew 500 ppm
Sep 29 06:42:01 dist-test-slave-ltw5 krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664121, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:01.657603 1544 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:42:01.657989 1544 webserver.cc:460] Webserver started at http://127.15.157.190:35903/ using document root <none> and password file <none>
I20260929 06:42:01.658278 1544 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:01.658344 1544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:01.658437 1544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:01.659513 1544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "cd849e3a51b64c929ff7a284675a63e5"
format_stamp: "Formatted at 2026-09-29 06:42:01 on dist-test-slave-ltw5"
server_key: "13bb3325c06512b1475b925cf0cb9a46"
server_key_iv: "7a809ac88881bcdb9482ed3a292459df"
server_key_version: "encryptionkey@0"
I20260929 06:42:01.659826 1544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "cd849e3a51b64c929ff7a284675a63e5"
format_stamp: "Formatted at 2026-09-29 06:42:01 on dist-test-slave-ltw5"
server_key: "13bb3325c06512b1475b925cf0cb9a46"
server_key_iv: "7a809ac88881bcdb9482ed3a292459df"
server_key_version: "encryptionkey@0"
I20260929 06:42:01.661109 1544 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:42:01.661793 1559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:01.661967 1544 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:42:01.662093 1544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "cd849e3a51b64c929ff7a284675a63e5"
format_stamp: "Formatted at 2026-09-29 06:42:01 on dist-test-slave-ltw5"
server_key: "13bb3325c06512b1475b925cf0cb9a46"
server_key_iv: "7a809ac88881bcdb9482ed3a292459df"
server_key_version: "encryptionkey@0"
I20260929 06:42:01.662177 1544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:01.680159 1544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:01.682664 1544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:01.682847 1544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:01.686764 1544 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:34445
I20260929 06:42:01.686818 1611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:34445 every 8 connection(s)
I20260929 06:42:01.687198 1544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:01.688102 1612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:01.688763 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 1544
I20260929 06:42:01.688853 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:01.689067 15990 external_mini_cluster.cc:1428] Setting key 3991190fea4f389b6d71b876dae1b06c
I20260929 06:42:01.691278 1612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5: Bootstrap starting.
I20260929 06:42:01.691990 1612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:01.692307 1612 log.cc:824] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:01.693022 1612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5: No bootstrap required, opened a new log
I20260929 06:42:01.695271 1612 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd849e3a51b64c929ff7a284675a63e5" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34445 } }
I20260929 06:42:01.695411 1612 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:01.695434 1612 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd849e3a51b64c929ff7a284675a63e5, State: Initialized, Role: FOLLOWER
I20260929 06:42:01.695572 1612 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd849e3a51b64c929ff7a284675a63e5" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34445 } }
I20260929 06:42:01.695647 1612 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:01.695668 1612 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:01.695737 1612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [term 0 FOLLOWER]: Advancing to term 1
Sep 29 06:42:01 dist-test-slave-ltw5 krb5kdc[1531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664121, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:01.696465 1612 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd849e3a51b64c929ff7a284675a63e5" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34445 } }
I20260929 06:42:01.696570 1612 leader_election.cc:302] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd849e3a51b64c929ff7a284675a63e5; no voters:
I20260929 06:42:01.696765 1612 leader_election.cc:288] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:01.696841 1617 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:01.696990 1617 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [term 1 LEADER]: Becoming Leader. State: Replica: cd849e3a51b64c929ff7a284675a63e5, State: Running, Role: LEADER
I20260929 06:42:01.697058 1612 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:01.697117 1617 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd849e3a51b64c929ff7a284675a63e5" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34445 } }
I20260929 06:42:01.697825 1618 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd849e3a51b64c929ff7a284675a63e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd849e3a51b64c929ff7a284675a63e5" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34445 } } }
I20260929 06:42:01.697909 1618 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:01.698448 1617 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd849e3a51b64c929ff7a284675a63e5. Latest consensus state: current_term: 1 leader_uuid: "cd849e3a51b64c929ff7a284675a63e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd849e3a51b64c929ff7a284675a63e5" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34445 } } }
I20260929 06:42:01.698683 1617 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5 [sys.catalog]: This master's current role is: LEADER
W20260929 06:42:01.699220 1633 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:42:01.699702 1633 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:42:01.700074 1629 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:01.700295 1629 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:01.701107 1615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:01.689649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44826 (local address 127.15.157.190:34445)
0929 06:42:01.689841 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:01.689851 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:01.689885 (+ 34us) server_negotiation.cc:407] Connection header received
0929 06:42:01.690502 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:01.690511 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:01.690579 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:01.690728 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:01.691335 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:01.692723 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:01.693522 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:01.694200 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:01.694323 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:01.697070 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:01.697074 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:01.697074 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:01.697087 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:01.699295 (+ 2208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:01.699823 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:01.699826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:01.699827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:01.699915 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:01.700152 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:01.700153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:01.700154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:01.700476 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:01.700639 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:01.700762 (+ 123us) server_negotiation.cc:299] Negotiation successful
0929 06:42:01.700908 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":79,"threads_started":1}
I20260929 06:42:01.702064 1629 catalog_manager.cc:1347] Generated new cluster ID: 3f18d5a7982044ab86a56b9dc5541841
I20260929 06:42:01.702116 1629 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:01.710074 1629 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:01.710837 1629 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:01.719059 1629 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5: Generated new TSK 0
I20260929 06:42:01.719309 1629 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:42:01.745456 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:34445
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:45059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:01.826438 1638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:01.826653 1638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:01.826678 1638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:01.827838 1638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:01.827886 1638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:01.827942 1638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:42:01.829424 1638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:45059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:34445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:01.829685 1638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:01.829926 1638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:01.834857 1643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:01.835057 1646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:01.834889 1644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:01.835084 1638 server_base.cc:1034] running on GCE node
I20260929 06:42:01.835343 1638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:01.835595 1638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:01.836736 1638 hybrid_clock.cc:648] HybridClock initialized: now 1790664121836711 us; error 51 us; skew 500 ppm
Sep 29 06:42:01 dist-test-slave-ltw5 krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664121, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:01.839303 1638 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:42:01.839828 1638 webserver.cc:460] Webserver started at http://127.15.157.129:43873/ using document root <none> and password file <none>
I20260929 06:42:01.840062 1638 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:01.840130 1638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:01.840266 1638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:01.841341 1638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "7750322865cb4c338df69012c2f2efa7"
format_stamp: "Formatted at 2026-09-29 06:42:01 on dist-test-slave-ltw5"
server_key: "39696b95e08bd7254e9d5a79af80b0de"
server_key_iv: "4e8011d6466ea3de3a32c451aaf2cb93"
server_key_version: "encryptionkey@0"
I20260929 06:42:01.841719 1638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "7750322865cb4c338df69012c2f2efa7"
format_stamp: "Formatted at 2026-09-29 06:42:01 on dist-test-slave-ltw5"
server_key: "39696b95e08bd7254e9d5a79af80b0de"
server_key_iv: "4e8011d6466ea3de3a32c451aaf2cb93"
server_key_version: "encryptionkey@0"
I20260929 06:42:01.843134 1638 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260929 06:42:01.843883 1653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:01.844066 1638 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:42:01.844162 1638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "7750322865cb4c338df69012c2f2efa7"
format_stamp: "Formatted at 2026-09-29 06:42:01 on dist-test-slave-ltw5"
server_key: "39696b95e08bd7254e9d5a79af80b0de"
server_key_iv: "4e8011d6466ea3de3a32c451aaf2cb93"
server_key_version: "encryptionkey@0"
I20260929 06:42:01.844250 1638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:01.863224 1638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:01.865347 1638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:01.865520 1638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:01.865777 1638 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:42:01.866205 1638 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:42:01.866243 1638 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:01.866267 1638 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:42:01.866318 1638 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:01.872184 1638 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:44781
I20260929 06:42:01.872224 1766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:44781 every 8 connection(s)
I20260929 06:42:01.872570 1638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:42:01 dist-test-slave-ltw5 krb5kdc[1531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664121, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:01.880980 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 1638
I20260929 06:42:01.881098 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:42:01.881345 15990 external_mini_cluster.cc:1428] Setting key 134341bfcaa1fd0f64b7705385aa9af4
I20260929 06:42:01.882225 1615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:01.873354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:45621 (local address 127.15.157.190:34445)
0929 06:42:01.873438 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:01.873441 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:01.873644 (+ 203us) server_negotiation.cc:407] Connection header received
0929 06:42:01.874201 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:01.874202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:01.874211 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:01.874267 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:01.875201 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:01.875698 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:01.876684 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:01.876898 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:01.876965 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:01.879126 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:01.879128 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:01.879128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:01.879135 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:01.880629 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:01.881125 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:01.881126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:01.881127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:01.881195 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:01.881509 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:01.881510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:01.881510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:01.881676 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:01.881743 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:01.882031 (+ 288us) server_negotiation.cc:299] Negotiation successful
0929 06:42:01.882131 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260929 06:42:01.882439 1769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:01.873326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:34445 (local address 127.15.157.129:45621)
0929 06:42:01.873509 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:01.873547 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:01.874104 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:01.874322 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:01.874326 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:01.874896 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:01.875091 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:01.875095 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:01.875783 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:01.875784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:01.876587 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:01.876589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:01.876981 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:01.876982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:01.877083 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:01.877618 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:01.877627 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:01.879016 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:01.880700 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:01.880705 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:01.880707 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:01.881039 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:01.881281 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:01.881282 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:01.881283 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:01.881427 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:01.881737 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:01.881745 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:01.881879 (+ 134us) client_negotiation.cc:769] Sending connection context
0929 06:42:01.881984 (+ 105us) client_negotiation.cc:240] Negotiation successful
0929 06:42:01.882182 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":104,"threads_started":1}
I20260929 06:42:01.882858 1767 heartbeater.cc:347] Connected to a master server at 127.15.157.190:34445
I20260929 06:42:01.882951 1767 heartbeater.cc:464] Registering TS with master...
I20260929 06:42:01.883150 1767 heartbeater.cc:511] Master 127.15.157.190:34445 requested a full tablet report, sending...
I20260929 06:42:01.883630 1576 ts_manager.cc:194] Registered new tserver with Master: 7750322865cb4c338df69012c2f2efa7 (127.15.157.129:44781)
I20260929 06:42:01.884239 1576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:45621
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:42:01.907042 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:34445
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:45059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:01.989373 1772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:01.989641 1772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:01.989681 1772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:01.990868 1772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:01.990945 1772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:01.990990 1772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:42:01.992455 1772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:45059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:34445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:01.992735 1772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:01.992971 1772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:01.998127 1778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:01.998055 1777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:01.998343 1772 server_base.cc:1034] running on GCE node
W20260929 06:42:01.998047 1780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:01.998649 1772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:01.998873 1772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:02.000034 1772 hybrid_clock.cc:648] HybridClock initialized: now 1790664122000022 us; error 27 us; skew 500 ppm
Sep 29 06:42:01 dist-test-slave-ltw5 krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664121, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:02.002574 1772 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:42:02.002950 1772 webserver.cc:460] Webserver started at http://127.15.157.130:42239/ using document root <none> and password file <none>
I20260929 06:42:02.003144 1772 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:02.003185 1772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:02.003286 1772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:02.004280 1772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e"
format_stamp: "Formatted at 2026-09-29 06:42:01 on dist-test-slave-ltw5"
server_key: "12242c0faa9fad2bdd4c094de82115e5"
server_key_iv: "dfe8d3db98c0e4950906f5c556c4c7cf"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.004576 1772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e"
format_stamp: "Formatted at 2026-09-29 06:42:01 on dist-test-slave-ltw5"
server_key: "12242c0faa9fad2bdd4c094de82115e5"
server_key_iv: "dfe8d3db98c0e4950906f5c556c4c7cf"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.005842 1772 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:42:02.006614 1787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.006788 1772 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.006868 1772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e"
format_stamp: "Formatted at 2026-09-29 06:42:01 on dist-test-slave-ltw5"
server_key: "12242c0faa9fad2bdd4c094de82115e5"
server_key_iv: "dfe8d3db98c0e4950906f5c556c4c7cf"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.006923 1772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:02.038955 1772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:02.041110 1772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:02.041230 1772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:02.041435 1772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:42:02.041801 1772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:42:02.041837 1772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.041896 1772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:42:02.041924 1772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.047744 1772 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:42927
I20260929 06:42:02.047827 1900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:42927 every 8 connection(s)
I20260929 06:42:02.048182 1772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:42:02.051985 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 1772
I20260929 06:42:02.052110 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:42:02.052315 15990 external_mini_cluster.cc:1428] Setting key 380e062580b58701f7662367c20b3fcf
Sep 29 06:42:02 dist-test-slave-ltw5 krb5kdc[1531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664121, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:02.058986 1615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.048933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:37043 (local address 127.15.157.190:34445)
0929 06:42:02.048982 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.048984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.049166 (+ 182us) server_negotiation.cc:407] Connection header received
0929 06:42:02.050300 (+ 1134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.050301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.050321 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.050384 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:02.051033 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.051531 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.052823 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.053103 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.053160 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.055956 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:02.055957 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:02.055957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:02.055964 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:02.057395 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:02.057912 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:02.057913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:02.057914 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:02.057964 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:02.058301 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:02.058301 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:02.058301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:02.058407 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:02.058492 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.058784 (+ 292us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.058887 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:42:02.059163 1903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.048879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:34445 (local address 127.15.157.130:37043)
0929 06:42:02.049046 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.049089 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:02.050172 (+ 1083us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:02.050462 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:02.050466 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:02.050721 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:02.050942 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.050947 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.051611 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.051611 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.052730 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.052734 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.053191 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.053192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.053341 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.053856 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:02.053867 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:02.055858 (+ 1991us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:02.057482 (+ 1624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:02.057489 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:02.057492 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:02.057825 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:02.058056 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:02.058057 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:02.058058 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:02.058212 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:02.058485 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:02.058492 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:02.058640 (+ 148us) client_negotiation.cc:769] Sending connection context
0929 06:42:02.058750 (+ 110us) client_negotiation.cc:240] Negotiation successful
0929 06:42:02.058917 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":93,"threads_started":1}
I20260929 06:42:02.059681 1901 heartbeater.cc:347] Connected to a master server at 127.15.157.190:34445
I20260929 06:42:02.059773 1901 heartbeater.cc:464] Registering TS with master...
I20260929 06:42:02.059967 1901 heartbeater.cc:511] Master 127.15.157.190:34445 requested a full tablet report, sending...
I20260929 06:42:02.060374 1576 ts_manager.cc:194] Registered new tserver with Master: 165bd3761c8e48e5b3c8e5fc3e0ea09e (127.15.157.130:42927)
I20260929 06:42:02.060773 1576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:37043
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:42:02.078727 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:34445
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:45059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:02.159269 1906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:02.159466 1906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:02.159488 1906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:02.160641 1906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:02.160684 1906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:02.160709 1906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:42:02.162340 1906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:45059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:34445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:02.162575 1906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:02.162835 1906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:02.167860 1911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:02.167925 1912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:02.167861 1914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:02.168031 1906 server_base.cc:1034] running on GCE node
I20260929 06:42:02.168263 1906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:02.168503 1906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:02.169659 1906 hybrid_clock.cc:648] HybridClock initialized: now 1790664122169634 us; error 41 us; skew 500 ppm
Sep 29 06:42:02 dist-test-slave-ltw5 krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664122, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:02.172128 1906 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:42:02.172487 1906 webserver.cc:460] Webserver started at http://127.15.157.131:44323/ using document root <none> and password file <none>
I20260929 06:42:02.172662 1906 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:02.172700 1906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:02.172785 1906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:02.173767 1906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "219393b2cb3a44afab91ef7d4c1788c2"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "e9ee65c4b2ffc876be75c2c3370937b4"
server_key_iv: "81bd52344bde226df561cd6636574334"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.174139 1906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "219393b2cb3a44afab91ef7d4c1788c2"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "e9ee65c4b2ffc876be75c2c3370937b4"
server_key_iv: "81bd52344bde226df561cd6636574334"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.175392 1906 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:02.176097 1921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.176312 1906 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:02.176404 1906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "219393b2cb3a44afab91ef7d4c1788c2"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "e9ee65c4b2ffc876be75c2c3370937b4"
server_key_iv: "81bd52344bde226df561cd6636574334"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.176460 1906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:02.206640 1906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:02.208654 1906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:02.208794 1906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:02.208998 1906 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:42:02.209353 1906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:42:02.209391 1906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.209444 1906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:42:02.209477 1906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.216017 1906 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:39709
I20260929 06:42:02.216158 2034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:39709 every 8 connection(s)
I20260929 06:42:02.216465 1906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:42:02 dist-test-slave-ltw5 krb5kdc[1531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664122, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:02.223897 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 1906
I20260929 06:42:02.224025 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:42:02.224236 15990 external_mini_cluster.cc:1428] Setting key c3c44fee98d5e25c945fe8e91d231d9e
I20260929 06:42:02.226660 1615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.217261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:50761 (local address 127.15.157.190:34445)
0929 06:42:02.217348 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.217351 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.217547 (+ 196us) server_negotiation.cc:407] Connection header received
0929 06:42:02.218001 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.218002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.218012 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.218131 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:02.219198 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.219836 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.220811 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.221007 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.221059 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.223162 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:02.223163 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:02.223164 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:02.223171 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:02.225078 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:02.225533 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:02.225534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:02.225534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:02.225597 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:02.225888 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:02.225889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:02.225890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:02.226073 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:02.226144 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.226470 (+ 326us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.226557 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260929 06:42:02.226874 2037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.217211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:34445 (local address 127.15.157.131:50761)
0929 06:42:02.217410 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.217446 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:02.217916 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:02.218198 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:02.218202 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:02.218863 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:02.219059 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.219063 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.219923 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.219924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.220737 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.220739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.221075 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.221076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.221182 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.221681 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:02.221689 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:02.223073 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:02.225160 (+ 2087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:02.225168 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:02.225170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:02.225430 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:02.225681 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:02.225681 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:02.225682 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:02.225810 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:02.226135 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:02.226143 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:02.226315 (+ 172us) client_negotiation.cc:769] Sending connection context
0929 06:42:02.226436 (+ 121us) client_negotiation.cc:240] Negotiation successful
0929 06:42:02.226614 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":110,"threads_started":1}
I20260929 06:42:02.227543 2035 heartbeater.cc:347] Connected to a master server at 127.15.157.190:34445
I20260929 06:42:02.227658 2035 heartbeater.cc:464] Registering TS with master...
I20260929 06:42:02.227859 2035 heartbeater.cc:511] Master 127.15.157.190:34445 requested a full tablet report, sending...
I20260929 06:42:02.228363 1576 ts_manager.cc:194] Registered new tserver with Master: 219393b2cb3a44afab91ef7d4c1788c2 (127.15.157.131:39709)
I20260929 06:42:02.228796 1576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:50761
I20260929 06:42:02.236123 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:42:02.243532 1615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.237485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44828 (local address 127.15.157.190:34445)
0929 06:42:02.237559 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.237561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.237620 (+ 59us) server_negotiation.cc:407] Connection header received
0929 06:42:02.237658 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.237659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.237668 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.237721 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:02.238363 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.238840 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.239542 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.239748 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.239815 (+ 67us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.241144 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:02.241146 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:02.241146 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:02.241152 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:02.242443 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:02.242806 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:02.242806 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:02.242807 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:02.242856 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:02.243036 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:02.243036 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:02.243036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:02.243159 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:02.243238 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.243363 (+ 125us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.243411 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260929 06:42:02.245280 1576 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44828:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:42:02.247026 1576 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:42:02.253615 2047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.249336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:39709 (local address 127.0.0.1:53840)
0929 06:42:02.249625 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.249670 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:02.249764 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:02.250009 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:02.250076 (+ 67us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:02.250079 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:02.250162 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.250164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.251195 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.251196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.252365 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.252367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.253294 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.253295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.253374 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.253388 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 06:42:02.253461 (+ 73us) client_negotiation.cc:240] Negotiation successful
0929 06:42:02.253517 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":60,"threads_started":1}
I20260929 06:42:02.253643 2049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.249508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53840 (local address 127.15.157.131:39709)
0929 06:42:02.249673 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.249679 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.249726 (+ 47us) server_negotiation.cc:407] Connection header received
0929 06:42:02.249882 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.249886 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.249904 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.249997 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:02.250256 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.251088 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.252457 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.253186 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.253267 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.253322 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.253490 (+ 168us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.253538 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":97,"threads_started":1}
I20260929 06:42:02.253939 2048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.249340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:42927 (local address 127.0.0.1:54026)
0929 06:42:02.249858 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.249869 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:02.249917 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:02.250348 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:02.250349 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:02.250350 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:02.250385 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.250386 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.251670 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.251671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.252711 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.252713 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.253682 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.253683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.253764 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.253768 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:42:02.253827 (+ 59us) client_negotiation.cc:240] Negotiation successful
0929 06:42:02.253870 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":2,"thread_start_us":102,"threads_started":1}
I20260929 06:42:02.254225 2051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.249698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54026 (local address 127.15.157.130:42927)
0929 06:42:02.250111 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.250115 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.250125 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:42:02.250162 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.250164 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.250181 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.250252 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:02.250472 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.251565 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.252815 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.253516 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.253597 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.253644 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.254090 (+ 446us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.254140 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":70,"threads_started":1}
I20260929 06:42:02.254467 2050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.249587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41612 (local address 127.15.157.129:44781)
0929 06:42:02.249918 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.249923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.249935 (+ 12us) server_negotiation.cc:407] Connection header received
0929 06:42:02.250037 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.250039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.250054 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.250126 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:02.250393 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.251532 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.252762 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.253280 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.253358 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.253414 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.253657 (+ 243us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.254383 (+ 726us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":102,"threads_started":1}
I20260929 06:42:02.254467 1969 tablet_service.cc:1467] Processing CreateTablet for tablet b274f81940354bf5b435e1034f991266 (DEFAULT_TABLE table=test-table [id=fd4ebd8cf2da474dbc1c09551f355f2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:02.254700 2046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.249349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:44781 (local address 127.0.0.1:41612)
0929 06:42:02.249879 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.249889 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:02.249929 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:02.250214 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:02.250215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:02.250217 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:02.250279 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.250281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.251647 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.251648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.252679 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.252681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.253446 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.253448 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.253499 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.253502 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:42:02.253545 (+ 43us) client_negotiation.cc:240] Negotiation successful
0929 06:42:02.253592 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"mutex_wait_us":29,"thread_start_us":73,"threads_started":1}
I20260929 06:42:02.254863 1969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b274f81940354bf5b435e1034f991266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:02.254905 1835 tablet_service.cc:1467] Processing CreateTablet for tablet b274f81940354bf5b435e1034f991266 (DEFAULT_TABLE table=test-table [id=fd4ebd8cf2da474dbc1c09551f355f2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:02.255244 1835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b274f81940354bf5b435e1034f991266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:02.255646 1701 tablet_service.cc:1467] Processing CreateTablet for tablet b274f81940354bf5b435e1034f991266 (DEFAULT_TABLE table=test-table [id=fd4ebd8cf2da474dbc1c09551f355f2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:02.255949 1701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b274f81940354bf5b435e1034f991266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:02.257776 2052 tablet_bootstrap.cc:492] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e: Bootstrap starting.
I20260929 06:42:02.258216 2053 tablet_bootstrap.cc:492] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2: Bootstrap starting.
I20260929 06:42:02.258430 2052 tablet_bootstrap.cc:654] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:02.258900 2053 tablet_bootstrap.cc:654] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:02.259040 2052 log.cc:824] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:02.259069 2054 tablet_bootstrap.cc:492] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7: Bootstrap starting.
I20260929 06:42:02.259447 2053 log.cc:824] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:02.259675 2054 tablet_bootstrap.cc:654] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:02.259963 2052 tablet_bootstrap.cc:492] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e: No bootstrap required, opened a new log
I20260929 06:42:02.260035 2052 ts_tablet_manager.cc:1397] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:42:02.260207 2053 tablet_bootstrap.cc:492] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2: No bootstrap required, opened a new log
I20260929 06:42:02.260233 2054 log.cc:824] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:02.260280 2053 ts_tablet_manager.cc:1397] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:42:02.260943 2054 tablet_bootstrap.cc:492] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7: No bootstrap required, opened a new log
I20260929 06:42:02.261003 2054 ts_tablet_manager.cc:1397] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:42:02.261999 2052 raft_consensus.cc:348] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219393b2cb3a44afab91ef7d4c1788c2" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39709 } } peers { permanent_uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42927 } } peers { permanent_uuid: "7750322865cb4c338df69012c2f2efa7" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 44781 } }
I20260929 06:42:02.262238 2052 raft_consensus.cc:374] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:02.262274 2052 raft_consensus.cc:729] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 165bd3761c8e48e5b3c8e5fc3e0ea09e, State: Initialized, Role: FOLLOWER
I20260929 06:42:02.262411 2052 consensus_queue.cc:260] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219393b2cb3a44afab91ef7d4c1788c2" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39709 } } peers { permanent_uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42927 } } peers { permanent_uuid: "7750322865cb4c338df69012c2f2efa7" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 44781 } }
I20260929 06:42:02.262496 2053 raft_consensus.cc:348] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219393b2cb3a44afab91ef7d4c1788c2" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39709 } } peers { permanent_uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42927 } } peers { permanent_uuid: "7750322865cb4c338df69012c2f2efa7" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 44781 } }
I20260929 06:42:02.262475 2054 raft_consensus.cc:348] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219393b2cb3a44afab91ef7d4c1788c2" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39709 } } peers { permanent_uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42927 } } peers { permanent_uuid: "7750322865cb4c338df69012c2f2efa7" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 44781 } }
I20260929 06:42:02.262667 2053 raft_consensus.cc:374] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:02.262692 2052 ts_tablet_manager.cc:1428] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260929 06:42:02.262684 2054 raft_consensus.cc:374] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:02.262704 2053 raft_consensus.cc:729] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 219393b2cb3a44afab91ef7d4c1788c2, State: Initialized, Role: FOLLOWER
I20260929 06:42:02.262733 2054 raft_consensus.cc:729] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7750322865cb4c338df69012c2f2efa7, State: Initialized, Role: FOLLOWER
I20260929 06:42:02.262836 1901 heartbeater.cc:503] Master 127.15.157.190:34445 was elected leader, sending a full tablet report...
I20260929 06:42:02.262830 2053 consensus_queue.cc:260] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219393b2cb3a44afab91ef7d4c1788c2" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39709 } } peers { permanent_uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42927 } } peers { permanent_uuid: "7750322865cb4c338df69012c2f2efa7" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 44781 } }
I20260929 06:42:02.263126 2053 ts_tablet_manager.cc:1428] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:42:02.263211 2035 heartbeater.cc:503] Master 127.15.157.190:34445 was elected leader, sending a full tablet report...
I20260929 06:42:02.263183 2054 consensus_queue.cc:260] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219393b2cb3a44afab91ef7d4c1788c2" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39709 } } peers { permanent_uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42927 } } peers { permanent_uuid: "7750322865cb4c338df69012c2f2efa7" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 44781 } }
I20260929 06:42:02.263471 2054 ts_tablet_manager.cc:1428] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:42:02.263510 1767 heartbeater.cc:503] Master 127.15.157.190:34445 was elected leader, sending a full tablet report...
W20260929 06:42:02.298764 1902 tablet.cc:2369] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:42:02.344389 2059 raft_consensus.cc:482] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:42:02.344516 2059 raft_consensus.cc:504] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219393b2cb3a44afab91ef7d4c1788c2" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39709 } } peers { permanent_uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42927 } } peers { permanent_uuid: "7750322865cb4c338df69012c2f2efa7" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 44781 } }
I20260929 06:42:02.344954 2059 leader_election.cc:288] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 165bd3761c8e48e5b3c8e5fc3e0ea09e (127.15.157.130:42927), 7750322865cb4c338df69012c2f2efa7 (127.15.157.129:44781)
I20260929 06:42:02.348946 2050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.345235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:49611 (local address 127.15.157.129:44781)
0929 06:42:02.345278 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.345280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.345488 (+ 208us) server_negotiation.cc:407] Connection header received
0929 06:42:02.345513 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.345515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.345524 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.345589 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:02.345726 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.346446 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.347998 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.348555 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.348637 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.348646 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.348838 (+ 192us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.348876 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:42:02.348946 2051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.345213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:50683 (local address 127.15.157.130:42927)
0929 06:42:02.345278 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.345281 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.345291 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:42:02.345320 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.345321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.345333 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.345390 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:02.345588 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.346386 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.348022 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.348566 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.348637 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.348646 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.348834 (+ 188us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.348873 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:42:02.348951 2037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.345129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:42927 (local address 127.15.157.131:50683)
0929 06:42:02.345181 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.345193 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:02.345238 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:02.345429 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:02.345430 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:02.345431 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:02.345513 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.345515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.346468 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.346469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.347892 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.347898 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.348665 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.348666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.348744 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.348746 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:42:02.348813 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 06:42:02.348859 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":69}
I20260929 06:42:02.348960 2061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.345137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:44781 (local address 127.15.157.131:49611)
0929 06:42:02.345361 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.345369 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:02.345444 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:02.345614 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:02.345615 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:02.345616 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:02.345661 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.345662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.346514 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.346515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.347804 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.347807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.348665 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.348666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.348742 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.348747 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:42:02.348826 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 06:42:02.348858 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":63,"thread_start_us":86,"threads_started":1}
I20260929 06:42:02.349305 1721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b274f81940354bf5b435e1034f991266" candidate_uuid: "219393b2cb3a44afab91ef7d4c1788c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7750322865cb4c338df69012c2f2efa7" is_pre_election: true
I20260929 06:42:02.349344 1855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b274f81940354bf5b435e1034f991266" candidate_uuid: "219393b2cb3a44afab91ef7d4c1788c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e" is_pre_election: true
I20260929 06:42:02.349478 1721 raft_consensus.cc:2454] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 219393b2cb3a44afab91ef7d4c1788c2 in term 0.
I20260929 06:42:02.349546 1855 raft_consensus.cc:2454] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 219393b2cb3a44afab91ef7d4c1788c2 in term 0.
I20260929 06:42:02.349748 1924 leader_election.cc:302] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 219393b2cb3a44afab91ef7d4c1788c2, 7750322865cb4c338df69012c2f2efa7; no voters:
I20260929 06:42:02.349889 2059 raft_consensus.cc:2781] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:42:02.349944 2059 raft_consensus.cc:482] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:42:02.349968 2059 raft_consensus.cc:3037] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:02.350860 2059 raft_consensus.cc:504] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219393b2cb3a44afab91ef7d4c1788c2" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39709 } } peers { permanent_uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42927 } } peers { permanent_uuid: "7750322865cb4c338df69012c2f2efa7" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 44781 } }
I20260929 06:42:02.351013 2059 leader_election.cc:288] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [CANDIDATE]: Term 1 election: Requested vote from peers 165bd3761c8e48e5b3c8e5fc3e0ea09e (127.15.157.130:42927), 7750322865cb4c338df69012c2f2efa7 (127.15.157.129:44781)
I20260929 06:42:02.351182 1721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b274f81940354bf5b435e1034f991266" candidate_uuid: "219393b2cb3a44afab91ef7d4c1788c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7750322865cb4c338df69012c2f2efa7"
I20260929 06:42:02.351182 1855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b274f81940354bf5b435e1034f991266" candidate_uuid: "219393b2cb3a44afab91ef7d4c1788c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e"
I20260929 06:42:02.351263 1721 raft_consensus.cc:3037] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:02.351264 1855 raft_consensus.cc:3037] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:02.352157 1721 raft_consensus.cc:2454] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 219393b2cb3a44afab91ef7d4c1788c2 in term 1.
I20260929 06:42:02.352157 1855 raft_consensus.cc:2454] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 219393b2cb3a44afab91ef7d4c1788c2 in term 1.
I20260929 06:42:02.352332 1924 leader_election.cc:302] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 219393b2cb3a44afab91ef7d4c1788c2, 7750322865cb4c338df69012c2f2efa7; no voters:
I20260929 06:42:02.352443 2059 raft_consensus.cc:2781] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:02.352599 2059 raft_consensus.cc:686] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [term 1 LEADER]: Becoming Leader. State: Replica: 219393b2cb3a44afab91ef7d4c1788c2, State: Running, Role: LEADER
I20260929 06:42:02.352708 2059 consensus_queue.cc:237] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219393b2cb3a44afab91ef7d4c1788c2" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39709 } } peers { permanent_uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42927 } } peers { permanent_uuid: "7750322865cb4c338df69012c2f2efa7" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 44781 } }
I20260929 06:42:02.353605 1576 catalog_manager.cc:5495] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 219393b2cb3a44afab91ef7d4c1788c2 (127.15.157.131). New cstate: current_term: 1 leader_uuid: "219393b2cb3a44afab91ef7d4c1788c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219393b2cb3a44afab91ef7d4c1788c2" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 39709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7750322865cb4c338df69012c2f2efa7" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260929 06:42:02.368703 2049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.366612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53842 (local address 127.15.157.131:39709)
0929 06:42:02.366658 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.366660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.366669 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:42:02.366726 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.366728 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.366744 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.366802 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:02.366908 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.367361 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.368061 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.368242 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.368295 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.368419 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:02.368503 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:02.368572 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.368618 (+ 46us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.368628 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:42:02.370625 1721 raft_consensus.cc:1261] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7 [term 1 FOLLOWER]: Refusing update from remote peer 219393b2cb3a44afab91ef7d4c1788c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:42:02.370635 1855 raft_consensus.cc:1261] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e [term 1 FOLLOWER]: Refusing update from remote peer 219393b2cb3a44afab91ef7d4c1788c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:42:02.370990 2062 consensus_queue.cc:1035] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7750322865cb4c338df69012c2f2efa7" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:42:02.371129 2059 consensus_queue.cc:1035] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "165bd3761c8e48e5b3c8e5fc3e0ea09e" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 42927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 06:42:02.373262 1768 tablet.cc:2369] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:42:02.373584 2065 mvcc.cc:205] Tried to move back new op lower bound from 7334560245226971136 to 7334560245157392384. Current Snapshot: MvccSnapshot[applied={T|T < 7334560245226971136}]
I20260929 06:42:02.373930 2066 mvcc.cc:205] Tried to move back new op lower bound from 7334560245226971136 to 7334560245157392384. Current Snapshot: MvccSnapshot[applied={T|T < 7334560245226971136}]
I20260929 06:42:02.376210 1575 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:42:02.376308 1575 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:42:02.377106 1575 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cd849e3a51b64c929ff7a284675a63e5: Sending DeleteTablet for 3 replicas of tablet b274f81940354bf5b435e1034f991266
I20260929 06:42:02.377408 1969 tablet_service.cc:1514] Processing DeleteTablet for tablet b274f81940354bf5b435e1034f991266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:02 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:53840
I20260929 06:42:02.377463 1701 tablet_service.cc:1514] Processing DeleteTablet for tablet b274f81940354bf5b435e1034f991266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:02 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:41612
I20260929 06:42:02.377658 2076 tablet_replica.cc:330] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7: stopping tablet replica
I20260929 06:42:02.377758 2076 raft_consensus.cc:2229] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:42:02.377734 1835 tablet_service.cc:1514] Processing DeleteTablet for tablet b274f81940354bf5b435e1034f991266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:02 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:54026
I20260929 06:42:02.377859 2076 raft_consensus.cc:2258] T b274f81940354bf5b435e1034f991266 P 7750322865cb4c338df69012c2f2efa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:42:02.377975 2075 tablet_replica.cc:330] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2: stopping tablet replica
I20260929 06:42:02.378073 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 1638
I20260929 06:42:02.378089 2075 raft_consensus.cc:2229] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:42:02.378199 2075 raft_consensus.cc:2258] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:42:02.378933 2075 ts_tablet_manager.cc:1905] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:42:02.380575 2075 ts_tablet_manager.cc:1918] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:42:02.380636 2075 log.cc:1196] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/b274f81940354bf5b435e1034f991266
I20260929 06:42:02.380882 2075 ts_tablet_manager.cc:1939] T b274f81940354bf5b435e1034f991266 P 219393b2cb3a44afab91ef7d4c1788c2: Deleting consensus metadata
I20260929 06:42:02.381194 1561 catalog_manager.cc:4841] TS 219393b2cb3a44afab91ef7d4c1788c2 (127.15.157.131:39709): tablet b274f81940354bf5b435e1034f991266 (table test-table [id=fd4ebd8cf2da474dbc1c09551f355f2f]) successfully deleted
I20260929 06:42:02.382529 2077 tablet_replica.cc:330] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e: stopping tablet replica
I20260929 06:42:02.382664 2077 raft_consensus.cc:2229] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:42:02.382793 2077 raft_consensus.cc:2258] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:42:02.383190 2077 ts_tablet_manager.cc:1905] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260929 06:42:02.384017 1562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:44781 (error 108)
I20260929 06:42:02.384557 2046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.384396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:44781 (local address 127.0.0.1:41628)
0929 06:42:02.384470 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.384513 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:44781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260929 06:42:02.384673 2077 ts_tablet_manager.cc:1918] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260929 06:42:02.384665 1562 catalog_manager.cc:4584] TS 7750322865cb4c338df69012c2f2efa7 (127.15.157.129:44781): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b274f81940354bf5b435e1034f991266: Network error: Client connection negotiation failed: client connection to 127.15.157.129:44781: connect: Connection refused (error 111)
I20260929 06:42:02.384737 2077 log.cc:1196] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/b274f81940354bf5b435e1034f991266
I20260929 06:42:02.384841 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 1772
I20260929 06:42:02.385046 2077 ts_tablet_manager.cc:1939] T b274f81940354bf5b435e1034f991266 P 165bd3761c8e48e5b3c8e5fc3e0ea09e: Deleting consensus metadata
I20260929 06:42:02.389709 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 1906
I20260929 06:42:02.389736 2046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.389627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:42927 (local address 127.0.0.1:54038)
0929 06:42:02.389673 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.389706 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.130:42927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260929 06:42:02.393780 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 1544
2026-09-29T06:42:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (1976 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-09-29T06:42:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:02Z Disabled control of system clock
I20260929 06:42:02.421458 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:33127
--webserver_interface=127.15.157.190
--webserver_port=0
--builtin_ntp_servers=127.15.157.148:35247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:33127
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:42:02.503682 2082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:02.503908 2082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:02.503929 2082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:02.505085 2082 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:02.505160 2082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:02.505182 2082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:02.505203 2082 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:02.505230 2082 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:02.506668 2082 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:35247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:33127
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:33127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:02.506951 2082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:02.507249 2082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:02.512030 2088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:02.512306 2082 server_base.cc:1034] running on GCE node
W20260929 06:42:02.512050 2090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:02.512034 2087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:02.512651 2082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:02.512938 2082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:02.514086 2082 hybrid_clock.cc:648] HybridClock initialized: now 1790664122514067 us; error 35 us; skew 500 ppm
I20260929 06:42:02.515267 2082 webserver.cc:460] Webserver started at http://127.15.157.190:42929/ using document root <none> and password file <none>
I20260929 06:42:02.515532 2082 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:02.515578 2082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:02.515729 2082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:02.516819 2082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "57fcd4ef2a62486e917c0b3660326aa6"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "a68ab0bf408063a22b8af844416a750c"
server_key_iv: "0225d49094a04f14b63fc2d1cbbbd108"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.517189 2082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "57fcd4ef2a62486e917c0b3660326aa6"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "a68ab0bf408063a22b8af844416a750c"
server_key_iv: "0225d49094a04f14b63fc2d1cbbbd108"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.518555 2082 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:42:02.519232 2096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.519421 2082 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:42:02.519510 2082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "57fcd4ef2a62486e917c0b3660326aa6"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "a68ab0bf408063a22b8af844416a750c"
server_key_iv: "0225d49094a04f14b63fc2d1cbbbd108"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.519582 2082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:02.552805 2082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:02.553149 2082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:02.553313 2082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:02.557608 2082 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:33127
I20260929 06:42:02.557672 2148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:33127 every 8 connection(s)
I20260929 06:42:02.558001 2082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:02.559002 2149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:02.561235 2149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6: Bootstrap starting.
I20260929 06:42:02.561770 2149 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:02.562057 2149 log.cc:824] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:02.562736 2149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6: No bootstrap required, opened a new log
I20260929 06:42:02.564294 2149 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57fcd4ef2a62486e917c0b3660326aa6" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 33127 } }
I20260929 06:42:02.564441 2149 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:02.564465 2149 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57fcd4ef2a62486e917c0b3660326aa6, State: Initialized, Role: FOLLOWER
I20260929 06:42:02.564625 2149 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57fcd4ef2a62486e917c0b3660326aa6" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 33127 } }
I20260929 06:42:02.564713 2149 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:02.564739 2149 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:02.564770 2149 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:02.565289 2149 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57fcd4ef2a62486e917c0b3660326aa6" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 33127 } }
I20260929 06:42:02.565378 2149 leader_election.cc:302] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57fcd4ef2a62486e917c0b3660326aa6; no voters:
I20260929 06:42:02.565514 2149 leader_election.cc:288] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:02.565600 2152 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:02.565788 2152 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [term 1 LEADER]: Becoming Leader. State: Replica: 57fcd4ef2a62486e917c0b3660326aa6, State: Running, Role: LEADER
I20260929 06:42:02.565836 2149 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:02.565898 2152 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57fcd4ef2a62486e917c0b3660326aa6" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 33127 } }
I20260929 06:42:02.566110 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 2082
I20260929 06:42:02.566214 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:02.566464 15990 external_mini_cluster.cc:1428] Setting key 8ca09a956aaa498801a0d26e6b405f26
I20260929 06:42:02.566524 2154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57fcd4ef2a62486e917c0b3660326aa6. Latest consensus state: current_term: 1 leader_uuid: "57fcd4ef2a62486e917c0b3660326aa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57fcd4ef2a62486e917c0b3660326aa6" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 33127 } } }
I20260929 06:42:02.566615 2154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:02.566773 2153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57fcd4ef2a62486e917c0b3660326aa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57fcd4ef2a62486e917c0b3660326aa6" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 33127 } } }
I20260929 06:42:02.566854 2153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:02.566990 2161 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:02.567531 2161 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:02.569273 2161 catalog_manager.cc:1347] Generated new cluster ID: ee048ef35ee24963b26b4b90131fa23a
I20260929 06:42:02.569329 2161 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:02.572719 2168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.567165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54724 (local address 127.15.157.190:33127)
0929 06:42:02.568042 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.568050 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.568075 (+ 25us) server_negotiation.cc:407] Connection header received
0929 06:42:02.568199 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.568206 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.568284 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.568442 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:02.568700 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.569841 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.570708 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.571151 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.571297 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.572022 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:02.572026 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:02.572026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:02.572208 (+ 182us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:02.572241 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:02.572251 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:02.572346 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.572424 (+ 78us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.572503 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":795,"thread_start_us":81,"threads_started":1}
I20260929 06:42:02.588830 2161 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:02.589403 2161 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:02.597754 2161 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6: Generated new TSK 0
I20260929 06:42:02.598018 2161 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:02.605618 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:33127
--builtin_ntp_servers=127.15.157.148:35247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:42:02.690886 2173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:02.691092 2173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:02.691113 2173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:02.692314 2173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:02.692358 2173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:02.692384 2173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:42:02.693770 2173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:35247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:33127
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:02.694024 2173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:02.694406 2173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:02.699656 2179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:02.699623 2181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:02.699635 2178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:02.700035 2173 server_base.cc:1034] running on GCE node
I20260929 06:42:02.700263 2173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:02.700570 2173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:02.701758 2173 hybrid_clock.cc:648] HybridClock initialized: now 1790664122701744 us; error 31 us; skew 500 ppm
I20260929 06:42:02.703131 2173 webserver.cc:460] Webserver started at http://127.15.157.129:44375/ using document root <none> and password file <none>
I20260929 06:42:02.703413 2173 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:02.703462 2173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:02.703612 2173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:02.704698 2173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "703173351245461c90eba16a936d86d8"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "80489fedf765ae6a34b258269117a0ad"
server_key_iv: "53251e8a9d6e2e2abe884c34e4dd2719"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.705058 2173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "703173351245461c90eba16a936d86d8"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "80489fedf765ae6a34b258269117a0ad"
server_key_iv: "53251e8a9d6e2e2abe884c34e4dd2719"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.706477 2173 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260929 06:42:02.707187 2187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.707366 2173 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:42:02.707458 2173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "703173351245461c90eba16a936d86d8"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "80489fedf765ae6a34b258269117a0ad"
server_key_iv: "53251e8a9d6e2e2abe884c34e4dd2719"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.707515 2173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:02.718852 2173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:02.719112 2173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:02.719213 2173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:02.719383 2173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:42:02.719635 2173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:42:02.719663 2173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.719683 2173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:42:02.719696 2173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.725342 2173 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:37563
I20260929 06:42:02.725456 2300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:37563 every 8 connection(s)
I20260929 06:42:02.725757 2173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:42:02.730674 2168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.726536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:39119 (local address 127.15.157.190:33127)
0929 06:42:02.726614 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.726617 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.726807 (+ 190us) server_negotiation.cc:407] Connection header received
0929 06:42:02.727276 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.727277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.727290 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.727351 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:02.727990 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.728477 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.729394 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.729578 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.729626 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.730438 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:02.730439 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:02.730439 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:02.730443 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:02.730457 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:02.730462 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:02.730505 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.730587 (+ 82us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.730614 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 06:42:02.730890 2303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.726488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:33127 (local address 127.15.157.129:39119)
0929 06:42:02.726685 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.726720 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:02.727192 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:02.727427 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:02.727430 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:02.727438 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:02.727918 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.727922 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.728552 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.728552 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.729320 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.729322 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.729646 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.729647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.729749 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.730304 (+ 555us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:42:02.730305 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:02.730333 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:42:02.730355 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:02.730516 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:02.730520 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:02.730522 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:42:02.730573 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 06:42:02.730651 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":100,"threads_started":1}
I20260929 06:42:02.731148 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 2173
I20260929 06:42:02.731287 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:42:02.731452 2301 heartbeater.cc:347] Connected to a master server at 127.15.157.190:33127
I20260929 06:42:02.731514 15990 external_mini_cluster.cc:1428] Setting key aa62b5c7dd4f84401e98720cbb3d8a87
I20260929 06:42:02.731561 2301 heartbeater.cc:464] Registering TS with master...
I20260929 06:42:02.731766 2301 heartbeater.cc:511] Master 127.15.157.190:33127 requested a full tablet report, sending...
I20260929 06:42:02.732308 2113 ts_manager.cc:194] Registered new tserver with Master: 703173351245461c90eba16a936d86d8 (127.15.157.129:37563)
I20260929 06:42:02.732425 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:33127
--builtin_ntp_servers=127.15.157.148:35247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260929 06:42:02.733011 2113 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.157.129:39119
W20260929 06:42:02.811736 2304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:02.811936 2304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:02.811959 2304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:02.813117 2304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:02.813158 2304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:02.813215 2304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:42:02.814625 2304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:35247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:33127
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:02.814883 2304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:02.815181 2304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:02.820461 2310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:02.820518 2304 server_base.cc:1034] running on GCE node
W20260929 06:42:02.820468 2312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:02.820468 2309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:02.820879 2304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:02.821159 2304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:02.822319 2304 hybrid_clock.cc:648] HybridClock initialized: now 1790664122822310 us; error 28 us; skew 500 ppm
I20260929 06:42:02.823563 2304 webserver.cc:460] Webserver started at http://127.15.157.130:46121/ using document root <none> and password file <none>
I20260929 06:42:02.823813 2304 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:02.823889 2304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:02.824033 2304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:02.825094 2304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "c8280ee52fe64ed7b3dad3a89de47fca"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "a2af976cb33022dd14032b3d36fafc65"
server_key_iv: "44835562e47dc14a2f4971f662d2c28a"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.825455 2304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "c8280ee52fe64ed7b3dad3a89de47fca"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "a2af976cb33022dd14032b3d36fafc65"
server_key_iv: "44835562e47dc14a2f4971f662d2c28a"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.826792 2304 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:42:02.827505 2318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.827672 2304 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:42:02.827771 2304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "c8280ee52fe64ed7b3dad3a89de47fca"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "a2af976cb33022dd14032b3d36fafc65"
server_key_iv: "44835562e47dc14a2f4971f662d2c28a"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.827854 2304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:02.841648 2304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:02.841948 2304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:02.842135 2304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:02.842363 2304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:42:02.842674 2304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:42:02.842727 2304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.842760 2304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:42:02.842787 2304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.848469 2304 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:37973
I20260929 06:42:02.848523 2431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:37973 every 8 connection(s)
I20260929 06:42:02.848824 2304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:42:02.853632 2168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.849528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:39627 (local address 127.15.157.190:33127)
0929 06:42:02.849588 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.849590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.849791 (+ 201us) server_negotiation.cc:407] Connection header received
0929 06:42:02.850342 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.850343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.850353 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.850416 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:02.851031 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.851530 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.852447 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.852628 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.852677 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.853397 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:02.853398 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:02.853399 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:02.853403 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:02.853415 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:02.853419 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:02.853461 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.853540 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.853573 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 06:42:02.853803 2434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.849489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:33127 (local address 127.15.157.130:39627)
0929 06:42:02.849665 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.849705 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:02.850250 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:02.850470 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:02.850474 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:02.850481 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:02.850964 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.850967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.851608 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.851609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.852373 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.852375 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.852697 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.852698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.852805 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.853271 (+ 466us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:42:02.853272 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:02.853299 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:42:02.853320 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:02.853471 (+ 151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:02.853475 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:02.853477 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:42:02.853528 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 06:42:02.853613 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
I20260929 06:42:02.854342 2432 heartbeater.cc:347] Connected to a master server at 127.15.157.190:33127
I20260929 06:42:02.854444 2432 heartbeater.cc:464] Registering TS with master...
I20260929 06:42:02.854616 2432 heartbeater.cc:511] Master 127.15.157.190:33127 requested a full tablet report, sending...
I20260929 06:42:02.855010 2113 ts_manager.cc:194] Registered new tserver with Master: c8280ee52fe64ed7b3dad3a89de47fca (127.15.157.130:37973)
I20260929 06:42:02.855389 2113 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.157.130:39627
I20260929 06:42:02.857560 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 2304
I20260929 06:42:02.857643 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:42:02.857844 15990 external_mini_cluster.cc:1428] Setting key 8885bd46991a08f73e2901171cd0d64f
I20260929 06:42:02.858891 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:33127
--builtin_ntp_servers=127.15.157.148:35247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:42:02.938352 2435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:02.938541 2435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:02.938563 2435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:02.939674 2435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:02.939711 2435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:02.939736 2435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:42:02.940972 2435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:35247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:33127
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:02.941144 2435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:02.941376 2435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:02.946185 2443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:02.946205 2441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:02.946234 2440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:02.946602 2435 server_base.cc:1034] running on GCE node
I20260929 06:42:02.946877 2435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:02.947101 2435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:02.948242 2435 hybrid_clock.cc:648] HybridClock initialized: now 1790664122948227 us; error 32 us; skew 500 ppm
I20260929 06:42:02.949507 2435 webserver.cc:460] Webserver started at http://127.15.157.131:40609/ using document root <none> and password file <none>
I20260929 06:42:02.949733 2435 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:02.949779 2435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:02.949946 2435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:02.950991 2435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "5370bf1ce10148b98a2ec5393f00062b"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "b6bb58c983e480c59ab7008777c9227e"
server_key_iv: "f0466addb2b5269f67fd5a3527ea8a11"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.951377 2435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "5370bf1ce10148b98a2ec5393f00062b"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "b6bb58c983e480c59ab7008777c9227e"
server_key_iv: "f0466addb2b5269f67fd5a3527ea8a11"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.953150 2435 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260929 06:42:02.954120 2449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.954345 2435 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:02.954440 2435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "5370bf1ce10148b98a2ec5393f00062b"
format_stamp: "Formatted at 2026-09-29 06:42:02 on dist-test-slave-ltw5"
server_key: "b6bb58c983e480c59ab7008777c9227e"
server_key_iv: "f0466addb2b5269f67fd5a3527ea8a11"
server_key_version: "encryptionkey@0"
I20260929 06:42:02.954511 2435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:02.961766 2435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:02.961987 2435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:02.962157 2435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:02.962332 2435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:42:02.962577 2435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:42:02.962606 2435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.962626 2435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:42:02.962639 2435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:02.968322 2435 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:45191
I20260929 06:42:02.968389 2562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:45191 every 8 connection(s)
I20260929 06:42:02.968696 2435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:42:02.973348 2168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.969367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:34761 (local address 127.15.157.190:33127)
0929 06:42:02.969411 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.969412 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.969617 (+ 205us) server_negotiation.cc:407] Connection header received
0929 06:42:02.970146 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.970147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.970157 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.970209 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:02.970811 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.971286 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.972189 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.972372 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.972421 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.973113 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:02.973114 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:02.973114 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:02.973118 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:02.973130 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:02.973134 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:02.973176 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.973258 (+ 82us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.973281 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:42:02.973477 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 2435
I20260929 06:42:02.973592 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:42:02.973613 2565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.969358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:33127 (local address 127.15.157.131:34761)
0929 06:42:02.969520 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.969549 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:02.970005 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:02.970265 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:02.970268 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:02.970276 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:02.970737 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.970742 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.971366 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.971367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.972117 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.972118 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.972438 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.972439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.972542 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.972991 (+ 449us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:42:02.972991 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:02.973016 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:42:02.973037 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:02.973189 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:02.973192 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:02.973194 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:42:02.973253 (+ 59us) client_negotiation.cc:240] Negotiation successful
0929 06:42:02.973376 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":81,"threads_started":1}
I20260929 06:42:02.973807 15990 external_mini_cluster.cc:1428] Setting key 9c9172e3a9ceaaefb09d2aad5de30854
I20260929 06:42:02.974131 2563 heartbeater.cc:347] Connected to a master server at 127.15.157.190:33127
I20260929 06:42:02.974221 2563 heartbeater.cc:464] Registering TS with master...
I20260929 06:42:02.974426 2563 heartbeater.cc:511] Master 127.15.157.190:33127 requested a full tablet report, sending...
I20260929 06:42:02.974795 2113 ts_manager.cc:194] Registered new tserver with Master: 5370bf1ce10148b98a2ec5393f00062b (127.15.157.131:45191)
I20260929 06:42:02.975160 2113 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.157.131:34761
I20260929 06:42:02.986191 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:42:02.990245 2168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.987561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54734 (local address 127.15.157.190:33127)
0929 06:42:02.987624 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.987626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.987722 (+ 96us) server_negotiation.cc:407] Connection header received
0929 06:42:02.987757 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.987757 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.987766 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.987818 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:02.987962 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.988412 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.989087 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.989253 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.989307 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.989957 (+ 650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:02.989958 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:02.989958 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:02.989962 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:02.989975 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:02.989979 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:02.990074 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.990181 (+ 107us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.990191 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:42:02.991879 2113 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54734:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:42:02.993345 2113 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:42:02.999475 2572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.995434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:37563 (local address 127.0.0.1:48848)
0929 06:42:02.995716 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.995757 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:02.995820 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:02.996042 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:02.996044 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:02.996046 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:02.996110 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.996112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.997190 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.997191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.998467 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.998470 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.999202 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.999203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.999276 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.999288 (+ 12us) client_negotiation.cc:769] Sending connection context
0929 06:42:02.999354 (+ 66us) client_negotiation.cc:240] Negotiation successful
0929 06:42:02.999402 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":59,"threads_started":1}
I20260929 06:42:02.999486 2574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.995519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48848 (local address 127.15.157.129:37563)
0929 06:42:02.995796 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.995809 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.995820 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:42:02.995912 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.995914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.995931 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.996217 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:02.996283 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.997100 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.998566 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.999101 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.999193 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.999285 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.999365 (+ 80us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.999403 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":104,"threads_started":1}
I20260929 06:42:02.999729 2571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.995436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:37973 (local address 127.0.0.1:50506)
0929 06:42:02.995719 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.995758 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:02.995823 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:02.996042 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:02.996045 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:02.996048 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:02.996118 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.996121 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.997514 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.997515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.998577 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.998579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.999489 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.999490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.999553 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.999559 (+ 6us) client_negotiation.cc:769] Sending connection context
0929 06:42:02.999615 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 06:42:02.999663 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":4,"spinlock_wait_cycles":896,"thread_start_us":103,"threads_started":1}
I20260929 06:42:02.999833 2575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.995640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:45191 (local address 127.0.0.1:49918)
0929 06:42:02.995994 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:02.996003 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:02.996052 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:02.996395 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:02.996396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:02.996398 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:02.996431 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.996432 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.997615 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.997616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.998519 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:02.998522 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.999600 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.999601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:02.999663 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.999667 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:42:02.999719 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 06:42:02.999756 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":63,"threads_started":1}
I20260929 06:42:03.000005 2573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.995530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50506 (local address 127.15.157.130:37973)
0929 06:42:02.995717 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.995722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.995904 (+ 182us) server_negotiation.cc:407] Connection header received
0929 06:42:02.995945 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.995947 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.995964 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.996041 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:02.996296 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.997422 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.998637 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.999306 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.999369 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.999452 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.999873 (+ 421us) server_negotiation.cc:299] Negotiation successful
0929 06:42:02.999925 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":85,"threads_started":1}
I20260929 06:42:03.000074 2576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:02.995830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49918 (local address 127.15.157.131:45191)
0929 06:42:02.995976 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:02.995980 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:02.996105 (+ 125us) server_negotiation.cc:407] Connection header received
0929 06:42:02.996144 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:02.996146 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:02.996161 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:02.996342 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:02.996505 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.997538 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.998581 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:02.999292 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:02.999369 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:02.999452 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:02.999965 (+ 513us) server_negotiation.cc:299] Negotiation successful
0929 06:42:03.000005 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":81,"threads_started":1}
I20260929 06:42:03.000229 2235 tablet_service.cc:1467] Processing CreateTablet for tablet bc25711f8c84454aaebad93cc16162be (DEFAULT_TABLE table=test-table [id=16eaee0e865c464aae0e19991af0047e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:03.000603 2235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc25711f8c84454aaebad93cc16162be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:03.000666 2366 tablet_service.cc:1467] Processing CreateTablet for tablet bc25711f8c84454aaebad93cc16162be (DEFAULT_TABLE table=test-table [id=16eaee0e865c464aae0e19991af0047e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:03.000981 2366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc25711f8c84454aaebad93cc16162be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:03.002388 2497 tablet_service.cc:1467] Processing CreateTablet for tablet bc25711f8c84454aaebad93cc16162be (DEFAULT_TABLE table=test-table [id=16eaee0e865c464aae0e19991af0047e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:03.002702 2497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc25711f8c84454aaebad93cc16162be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:03.004154 2577 tablet_bootstrap.cc:492] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8: Bootstrap starting.
I20260929 06:42:03.004873 2577 tablet_bootstrap.cc:654] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:03.005195 2577 log.cc:824] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:03.005532 2578 tablet_bootstrap.cc:492] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca: Bootstrap starting.
I20260929 06:42:03.005900 2580 tablet_bootstrap.cc:492] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b: Bootstrap starting.
I20260929 06:42:03.006187 2578 tablet_bootstrap.cc:654] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:03.006197 2577 tablet_bootstrap.cc:492] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8: No bootstrap required, opened a new log
I20260929 06:42:03.006278 2577 ts_tablet_manager.cc:1397] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:42:03.006497 2578 log.cc:824] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:03.006542 2580 tablet_bootstrap.cc:654] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:03.006870 2580 log.cc:824] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:03.007341 2578 tablet_bootstrap.cc:492] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca: No bootstrap required, opened a new log
I20260929 06:42:03.007436 2578 ts_tablet_manager.cc:1397] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:42:03.007612 2580 tablet_bootstrap.cc:492] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b: No bootstrap required, opened a new log
I20260929 06:42:03.007682 2580 ts_tablet_manager.cc:1397] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:42:03.008988 2577 raft_consensus.cc:348] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "703173351245461c90eba16a936d86d8" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37563 } } peers { permanent_uuid: "c8280ee52fe64ed7b3dad3a89de47fca" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37973 } } peers { permanent_uuid: "5370bf1ce10148b98a2ec5393f00062b" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 45191 } }
I20260929 06:42:03.009161 2577 raft_consensus.cc:374] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:03.009204 2577 raft_consensus.cc:729] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 703173351245461c90eba16a936d86d8, State: Initialized, Role: FOLLOWER
I20260929 06:42:03.009351 2577 consensus_queue.cc:260] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "703173351245461c90eba16a936d86d8" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37563 } } peers { permanent_uuid: "c8280ee52fe64ed7b3dad3a89de47fca" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37973 } } peers { permanent_uuid: "5370bf1ce10148b98a2ec5393f00062b" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 45191 } }
I20260929 06:42:03.009348 2578 raft_consensus.cc:348] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "703173351245461c90eba16a936d86d8" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37563 } } peers { permanent_uuid: "c8280ee52fe64ed7b3dad3a89de47fca" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37973 } } peers { permanent_uuid: "5370bf1ce10148b98a2ec5393f00062b" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 45191 } }
I20260929 06:42:03.009516 2578 raft_consensus.cc:374] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:03.009558 2578 raft_consensus.cc:729] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8280ee52fe64ed7b3dad3a89de47fca, State: Initialized, Role: FOLLOWER
I20260929 06:42:03.009611 2577 ts_tablet_manager.cc:1428] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:42:03.009680 2578 consensus_queue.cc:260] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "703173351245461c90eba16a936d86d8" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37563 } } peers { permanent_uuid: "c8280ee52fe64ed7b3dad3a89de47fca" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37973 } } peers { permanent_uuid: "5370bf1ce10148b98a2ec5393f00062b" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 45191 } }
I20260929 06:42:03.009735 2301 heartbeater.cc:503] Master 127.15.157.190:33127 was elected leader, sending a full tablet report...
I20260929 06:42:03.009917 2578 ts_tablet_manager.cc:1428] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:42:03.010007 2432 heartbeater.cc:503] Master 127.15.157.190:33127 was elected leader, sending a full tablet report...
I20260929 06:42:03.010821 2580 raft_consensus.cc:348] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "703173351245461c90eba16a936d86d8" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37563 } } peers { permanent_uuid: "c8280ee52fe64ed7b3dad3a89de47fca" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37973 } } peers { permanent_uuid: "5370bf1ce10148b98a2ec5393f00062b" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 45191 } }
I20260929 06:42:03.010977 2580 raft_consensus.cc:374] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:03.011020 2580 raft_consensus.cc:729] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5370bf1ce10148b98a2ec5393f00062b, State: Initialized, Role: FOLLOWER
I20260929 06:42:03.011130 2580 consensus_queue.cc:260] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "703173351245461c90eba16a936d86d8" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37563 } } peers { permanent_uuid: "c8280ee52fe64ed7b3dad3a89de47fca" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37973 } } peers { permanent_uuid: "5370bf1ce10148b98a2ec5393f00062b" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 45191 } }
I20260929 06:42:03.011425 2580 ts_tablet_manager.cc:1428] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260929 06:42:03.011425 2563 heartbeater.cc:503] Master 127.15.157.190:33127 was elected leader, sending a full tablet report...
I20260929 06:42:03.056334 2583 raft_consensus.cc:482] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:42:03.056504 2583 raft_consensus.cc:504] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "703173351245461c90eba16a936d86d8" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37563 } } peers { permanent_uuid: "c8280ee52fe64ed7b3dad3a89de47fca" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37973 } } peers { permanent_uuid: "5370bf1ce10148b98a2ec5393f00062b" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 45191 } }
I20260929 06:42:03.056831 2583 leader_election.cc:288] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8280ee52fe64ed7b3dad3a89de47fca (127.15.157.130:37973), 5370bf1ce10148b98a2ec5393f00062b (127.15.157.131:45191)
I20260929 06:42:03.060448 2576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:03.057214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:51759 (local address 127.15.157.131:45191)
0929 06:42:03.057269 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:03.057271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:03.057434 (+ 163us) server_negotiation.cc:407] Connection header received
0929 06:42:03.057468 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:03.057469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:03.057479 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:03.057526 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:03.057658 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:03.058318 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:03.059566 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:03.060086 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:03.060162 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:03.060171 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:03.060337 (+ 166us) server_negotiation.cc:299] Negotiation successful
0929 06:42:03.060375 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 06:42:03.060448 2573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:03.057125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:45065 (local address 127.15.157.130:37973)
0929 06:42:03.057173 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:03.057175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:03.057184 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:42:03.057216 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:03.057217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:03.057227 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:03.057286 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:03.057491 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:03.058141 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:03.059521 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:03.060082 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:03.060162 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:03.060171 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:03.060337 (+ 166us) server_negotiation.cc:299] Negotiation successful
0929 06:42:03.060375 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:42:03.060456 2303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:03.057019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:37973 (local address 127.15.157.129:45065)
0929 06:42:03.057082 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:03.057096 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:03.057154 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:03.057298 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:03.057300 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:03.057302 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:03.057374 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:03.057376 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:03.058230 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:03.058231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:03.059431 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:03.059433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:03.060176 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:03.060177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:03.060252 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:03.060256 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:42:03.060328 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 06:42:03.060365 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":21}
I20260929 06:42:03.060461 2586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:03.057147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:45191 (local address 127.15.157.129:51759)
0929 06:42:03.057367 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:03.057375 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:03.057417 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:03.057539 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:03.057539 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:03.057541 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:03.057602 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:03.057604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:03.058401 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:03.058402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:03.059491 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:03.059493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:03.060180 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:03.060180 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:03.060255 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:03.060257 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:42:03.060318 (+ 61us) client_negotiation.cc:240] Negotiation successful
0929 06:42:03.060363 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":5,"thread_start_us":155,"threads_started":1}
I20260929 06:42:03.060823 2386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc25711f8c84454aaebad93cc16162be" candidate_uuid: "703173351245461c90eba16a936d86d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8280ee52fe64ed7b3dad3a89de47fca" is_pre_election: true
I20260929 06:42:03.060967 2386 raft_consensus.cc:2454] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 703173351245461c90eba16a936d86d8 in term 0.
I20260929 06:42:03.061223 2189 leader_election.cc:302] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 703173351245461c90eba16a936d86d8, c8280ee52fe64ed7b3dad3a89de47fca; no voters:
I20260929 06:42:03.061215 2517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc25711f8c84454aaebad93cc16162be" candidate_uuid: "703173351245461c90eba16a936d86d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5370bf1ce10148b98a2ec5393f00062b" is_pre_election: true
I20260929 06:42:03.061348 2517 raft_consensus.cc:2454] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 703173351245461c90eba16a936d86d8 in term 0.
I20260929 06:42:03.061381 2583 raft_consensus.cc:2781] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:42:03.061455 2583 raft_consensus.cc:482] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:42:03.061488 2583 raft_consensus.cc:3037] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:03.062229 2583 raft_consensus.cc:504] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "703173351245461c90eba16a936d86d8" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37563 } } peers { permanent_uuid: "c8280ee52fe64ed7b3dad3a89de47fca" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37973 } } peers { permanent_uuid: "5370bf1ce10148b98a2ec5393f00062b" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 45191 } }
I20260929 06:42:03.062373 2583 leader_election.cc:288] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [CANDIDATE]: Term 1 election: Requested vote from peers c8280ee52fe64ed7b3dad3a89de47fca (127.15.157.130:37973), 5370bf1ce10148b98a2ec5393f00062b (127.15.157.131:45191)
I20260929 06:42:03.062559 2517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc25711f8c84454aaebad93cc16162be" candidate_uuid: "703173351245461c90eba16a936d86d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5370bf1ce10148b98a2ec5393f00062b"
I20260929 06:42:03.062570 2386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc25711f8c84454aaebad93cc16162be" candidate_uuid: "703173351245461c90eba16a936d86d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8280ee52fe64ed7b3dad3a89de47fca"
I20260929 06:42:03.062650 2517 raft_consensus.cc:3037] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:03.062646 2386 raft_consensus.cc:3037] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:03.063378 2386 raft_consensus.cc:2454] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 703173351245461c90eba16a936d86d8 in term 1.
I20260929 06:42:03.063460 2517 raft_consensus.cc:2454] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 703173351245461c90eba16a936d86d8 in term 1.
I20260929 06:42:03.063561 2189 leader_election.cc:302] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 703173351245461c90eba16a936d86d8, c8280ee52fe64ed7b3dad3a89de47fca; no voters:
I20260929 06:42:03.063660 2583 raft_consensus.cc:2781] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:03.063817 2583 raft_consensus.cc:686] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [term 1 LEADER]: Becoming Leader. State: Replica: 703173351245461c90eba16a936d86d8, State: Running, Role: LEADER
I20260929 06:42:03.063928 2583 consensus_queue.cc:237] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "703173351245461c90eba16a936d86d8" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37563 } } peers { permanent_uuid: "c8280ee52fe64ed7b3dad3a89de47fca" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37973 } } peers { permanent_uuid: "5370bf1ce10148b98a2ec5393f00062b" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 45191 } }
I20260929 06:42:03.064725 2113 catalog_manager.cc:5495] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 703173351245461c90eba16a936d86d8 (127.15.157.129). New cstate: current_term: 1 leader_uuid: "703173351245461c90eba16a936d86d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "703173351245461c90eba16a936d86d8" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 37563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8280ee52fe64ed7b3dad3a89de47fca" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5370bf1ce10148b98a2ec5393f00062b" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260929 06:42:03.072151 2574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:03.069953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48860 (local address 127.15.157.129:37563)
0929 06:42:03.070006 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:03.070007 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:03.070121 (+ 114us) server_negotiation.cc:407] Connection header received
0929 06:42:03.070181 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:03.070182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:03.070198 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:03.070256 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:03.070373 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:03.070814 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:03.071490 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:03.071660 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:03.071707 (+ 47us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:03.071835 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:03.071913 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:03.071979 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:03.072022 (+ 43us) server_negotiation.cc:299] Negotiation successful
0929 06:42:03.072031 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 06:42:03.073781 2517 raft_consensus.cc:1261] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b [term 1 FOLLOWER]: Refusing update from remote peer 703173351245461c90eba16a936d86d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:42:03.074239 2386 raft_consensus.cc:1261] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca [term 1 FOLLOWER]: Refusing update from remote peer 703173351245461c90eba16a936d86d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:42:03.074363 2583 consensus_queue.cc:1035] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5370bf1ce10148b98a2ec5393f00062b" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:42:03.074570 2587 consensus_queue.cc:1035] T bc25711f8c84454aaebad93cc16162be P 703173351245461c90eba16a936d86d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8280ee52fe64ed7b3dad3a89de47fca" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 37973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:42:03.076797 2590 mvcc.cc:205] Tried to move back new op lower bound from 7334560248107724800 to 7334560248070516736. Current Snapshot: MvccSnapshot[applied={T|T < 7334560248107724800 or (T in {7334560248107724800})}]
I20260929 06:42:03.078217 2593 mvcc.cc:205] Tried to move back new op lower bound from 7334560248107724800 to 7334560248070516736. Current Snapshot: MvccSnapshot[applied={T|T < 7334560248107724800 or (T in {7334560248107724800})}]
I20260929 06:42:03.078361 2591 mvcc.cc:205] Tried to move back new op lower bound from 7334560248107724800 to 7334560248070516736. Current Snapshot: MvccSnapshot[applied={T|T < 7334560248107724800}]
I20260929 06:42:03.078799 2113 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54734:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:42:03.078907 2113 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54734:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:42:03.079710 2113 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57fcd4ef2a62486e917c0b3660326aa6: Sending DeleteTablet for 3 replicas of tablet bc25711f8c84454aaebad93cc16162be
I20260929 06:42:03.080032 2235 tablet_service.cc:1514] Processing DeleteTablet for tablet bc25711f8c84454aaebad93cc16162be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:03 UTC) from {username='slave'} at 127.0.0.1:48848
I20260929 06:42:03.080061 2366 tablet_service.cc:1514] Processing DeleteTablet for tablet bc25711f8c84454aaebad93cc16162be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:03 UTC) from {username='slave'} at 127.0.0.1:50506
I20260929 06:42:03.080276 2600 tablet_replica.cc:330] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca: stopping tablet replica
I20260929 06:42:03.080291 2497 tablet_service.cc:1514] Processing DeleteTablet for tablet bc25711f8c84454aaebad93cc16162be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:03 UTC) from {username='slave'} at 127.0.0.1:49918
I20260929 06:42:03.080386 2600 raft_consensus.cc:2229] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:42:03.080420 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 2173
I20260929 06:42:03.080485 2600 raft_consensus.cc:2258] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:42:03.081182 2601 tablet_replica.cc:330] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b: stopping tablet replica
I20260929 06:42:03.081285 2601 raft_consensus.cc:2229] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:42:03.081341 2600 ts_tablet_manager.cc:1905] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:42:03.081380 2601 raft_consensus.cc:2258] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:42:03.081789 2601 ts_tablet_manager.cc:1905] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:42:03.083269 2600 ts_tablet_manager.cc:1918] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:42:03.083351 2600 log.cc:1196] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/bc25711f8c84454aaebad93cc16162be
I20260929 06:42:03.083640 2600 ts_tablet_manager.cc:1939] T bc25711f8c84454aaebad93cc16162be P c8280ee52fe64ed7b3dad3a89de47fca: Deleting consensus metadata
I20260929 06:42:03.083636 2601 ts_tablet_manager.cc:1918] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:42:03.083714 2601 log.cc:1196] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/bc25711f8c84454aaebad93cc16162be
I20260929 06:42:03.084043 2601 ts_tablet_manager.cc:1939] T bc25711f8c84454aaebad93cc16162be P 5370bf1ce10148b98a2ec5393f00062b: Deleting consensus metadata
I20260929 06:42:03.084057 2098 catalog_manager.cc:4841] TS c8280ee52fe64ed7b3dad3a89de47fca (127.15.157.130:37973): tablet bc25711f8c84454aaebad93cc16162be (table test-table [id=16eaee0e865c464aae0e19991af0047e]) successfully deleted
I20260929 06:42:03.084462 2098 catalog_manager.cc:4841] TS 5370bf1ce10148b98a2ec5393f00062b (127.15.157.131:45191): tablet bc25711f8c84454aaebad93cc16162be (table test-table [id=16eaee0e865c464aae0e19991af0047e]) successfully deleted
W20260929 06:42:03.086905 2097 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:37563 (error 108)
I20260929 06:42:03.087352 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 2304
I20260929 06:42:03.087422 2575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:03.087284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:37563 (local address 127.0.0.1:48862)
0929 06:42:03.087358 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:03.087395 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:37563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260929 06:42:03.088030 2097 catalog_manager.cc:4584] TS 703173351245461c90eba16a936d86d8 (127.15.157.129:37563): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bc25711f8c84454aaebad93cc16162be: Network error: Client connection negotiation failed: client connection to 127.15.157.129:37563: connect: Connection refused (error 111)
I20260929 06:42:03.092113 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 2435
I20260929 06:42:03.096683 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 2082
2026-09-29T06:42:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (701 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:03 dist-test-slave-ltw5 krb5kdc[2605](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:03 dist-test-slave-ltw5 krb5kdc[2605](info): set up 2 sockets
Sep 29 06:42:03 dist-test-slave-ltw5 krb5kdc[2605](info): commencing operation
krb5kdc: starting...
W20260929 06:42:04.133908 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:04 dist-test-slave-ltw5 krb5kdc[2605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:42:04.249290 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:42319
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:42319
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:04.328071 2618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:04.328313 2618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:04.328349 2618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:04.329499 2618 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:04.329568 2618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:04.329591 2618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:04.329612 2618 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:04.329641 2618 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:04.331102 2618 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:42319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:42319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:04.331377 2618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:04.331602 2618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:04.336346 2624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:04.336479 2618 server_base.cc:1034] running on GCE node
W20260929 06:42:04.336349 2626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:04.336669 2623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:04.336963 2618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:04.337276 2618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:04.338426 2618 hybrid_clock.cc:648] HybridClock initialized: now 1790664124338413 us; error 30 us; skew 500 ppm
Sep 29 06:42:04 dist-test-slave-ltw5 krb5kdc[2605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664124, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:04.348230 2618 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:42:04.348701 2618 webserver.cc:460] Webserver started at http://127.15.157.190:44319/ using document root <none> and password file <none>
I20260929 06:42:04.348935 2618 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:04.348984 2618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:04.349143 2618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:04.350333 2618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "ac3a94e544a44e368af93a0cd40979b0"
format_stamp: "Formatted at 2026-09-29 06:42:04 on dist-test-slave-ltw5"
server_key: "b31adc937e2fffb4b336d4338b801f96"
server_key_iv: "e6ddb2eb53b354436712bb4dcabc8d91"
server_key_version: "encryptionkey@0"
I20260929 06:42:04.350703 2618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "ac3a94e544a44e368af93a0cd40979b0"
format_stamp: "Formatted at 2026-09-29 06:42:04 on dist-test-slave-ltw5"
server_key: "b31adc937e2fffb4b336d4338b801f96"
server_key_iv: "e6ddb2eb53b354436712bb4dcabc8d91"
server_key_version: "encryptionkey@0"
I20260929 06:42:04.352070 2618 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:42:04.352788 2633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:04.352975 2618 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:42:04.353065 2618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "ac3a94e544a44e368af93a0cd40979b0"
format_stamp: "Formatted at 2026-09-29 06:42:04 on dist-test-slave-ltw5"
server_key: "b31adc937e2fffb4b336d4338b801f96"
server_key_iv: "e6ddb2eb53b354436712bb4dcabc8d91"
server_key_version: "encryptionkey@0"
I20260929 06:42:04.353120 2618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:04.360809 2618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:04.363014 2618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:04.363121 2618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:04.366945 2618 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:42319
I20260929 06:42:04.366997 2685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:42319 every 8 connection(s)
I20260929 06:42:04.367322 2618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:04.368165 2686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:04.370539 2686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0: Bootstrap starting.
I20260929 06:42:04.371109 2686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:04.371402 2686 log.cc:824] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:04.372062 2686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0: No bootstrap required, opened a new log
I20260929 06:42:04.373647 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 2618
I20260929 06:42:04.373739 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:04.373919 15990 external_mini_cluster.cc:1428] Setting key 9930f6b95405d59e991cfe19a1aa35bc
I20260929 06:42:04.373909 2686 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3a94e544a44e368af93a0cd40979b0" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 42319 } }
I20260929 06:42:04.374169 2686 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:04.374225 2686 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3a94e544a44e368af93a0cd40979b0, State: Initialized, Role: FOLLOWER
I20260929 06:42:04.374387 2686 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3a94e544a44e368af93a0cd40979b0" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 42319 } }
I20260929 06:42:04.374486 2686 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:04.374532 2686 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:04.374594 2686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:04.375645 2686 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3a94e544a44e368af93a0cd40979b0" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 42319 } }
I20260929 06:42:04.375751 2686 leader_election.cc:302] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac3a94e544a44e368af93a0cd40979b0; no voters:
I20260929 06:42:04.375914 2686 leader_election.cc:288] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:04.375984 2691 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:04.376163 2686 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:04.376178 2691 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [term 1 LEADER]: Becoming Leader. State: Replica: ac3a94e544a44e368af93a0cd40979b0, State: Running, Role: LEADER
I20260929 06:42:04.376296 2691 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3a94e544a44e368af93a0cd40979b0" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 42319 } }
I20260929 06:42:04.376590 2691 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac3a94e544a44e368af93a0cd40979b0. Latest consensus state: current_term: 1 leader_uuid: "ac3a94e544a44e368af93a0cd40979b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3a94e544a44e368af93a0cd40979b0" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 42319 } } }
I20260929 06:42:04.376683 2691 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:04.376600 2692 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac3a94e544a44e368af93a0cd40979b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3a94e544a44e368af93a0cd40979b0" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 42319 } } }
I20260929 06:42:04.376830 2692 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:04.376901 2699 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:04.377403 2699 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:04.379225 2699 catalog_manager.cc:1347] Generated new cluster ID: 691c5eef7bd7475b9ce6c02498b8b513
I20260929 06:42:04.379292 2699 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:42:04 dist-test-slave-ltw5 krb5kdc[2605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:04.385433 2690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.374453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55298 (local address 127.15.157.190:42319)
0929 06:42:04.374669 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:04.374678 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:04.374713 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:42:04.374833 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:04.374840 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:04.374893 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:04.375053 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:04.375623 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.377156 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.378258 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.378906 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.379010 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.381893 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:04.381897 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:04.381897 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:04.381909 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:04.383802 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:04.384249 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:04.384252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:04.384252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:04.384358 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:04.384576 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:04.384577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:04.384577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:04.384855 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:04.384989 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:04.385119 (+ 130us) server_negotiation.cc:299] Negotiation successful
0929 06:42:04.385241 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":90,"threads_started":1}
I20260929 06:42:04.388339 2699 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:04.388794 2699 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:04.396772 2699 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0: Generated new TSK 0
I20260929 06:42:04.396948 2699 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.157.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
Entry for principal kudu/127.15.157.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab.
I20260929 06:42:04.424588 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:42319
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:04.517256 2712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:04.517462 2712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:04.517485 2712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:04.518599 2712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:04.518633 2712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:04.518658 2712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:42:04.520102 2712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.129.keytab
--principal=kudu/127.15.157.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:42319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:04.520361 2712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:04.520623 2712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:04.525454 2718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:04.525462 2717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:04.525516 2712 server_base.cc:1034] running on GCE node
W20260929 06:42:04.525455 2720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:04.525813 2712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:04.526108 2712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:04.527263 2712 hybrid_clock.cc:648] HybridClock initialized: now 1790664124527241 us; error 40 us; skew 500 ppm
Sep 29 06:42:04 dist-test-slave-ltw5 krb5kdc[2605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664124, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:04.529628 2712 init.cc:377] Logged in from keytab as kudu/127.15.157.129@KRBTEST.COM (short username kudu)
I20260929 06:42:04.530082 2712 webserver.cc:460] Webserver started at http://127.15.157.129:33179/ using document root <none> and password file <none>
I20260929 06:42:04.530319 2712 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:04.530392 2712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:04.530522 2712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:04.531533 2712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "89b47f6ce3e94ac18c253a05287d0266"
format_stamp: "Formatted at 2026-09-29 06:42:04 on dist-test-slave-ltw5"
server_key: "8e9cabe7598a4ea3986bee147cdd7e76"
server_key_iv: "388c7a70855aec8945e140d01a6b4eb2"
server_key_version: "encryptionkey@0"
I20260929 06:42:04.531908 2712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "89b47f6ce3e94ac18c253a05287d0266"
format_stamp: "Formatted at 2026-09-29 06:42:04 on dist-test-slave-ltw5"
server_key: "8e9cabe7598a4ea3986bee147cdd7e76"
server_key_iv: "388c7a70855aec8945e140d01a6b4eb2"
server_key_version: "encryptionkey@0"
I20260929 06:42:04.533218 2712 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:42:04.533955 2727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:04.534139 2712 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:42:04.534247 2712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "89b47f6ce3e94ac18c253a05287d0266"
format_stamp: "Formatted at 2026-09-29 06:42:04 on dist-test-slave-ltw5"
server_key: "8e9cabe7598a4ea3986bee147cdd7e76"
server_key_iv: "388c7a70855aec8945e140d01a6b4eb2"
server_key_version: "encryptionkey@0"
I20260929 06:42:04.534332 2712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:04.551015 2712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:04.552807 2712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:04.552965 2712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:04.553193 2712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:42:04.553493 2712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:42:04.553546 2712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:04.553599 2712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:42:04.553627 2712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:04.559613 2712 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:45685
I20260929 06:42:04.559650 2840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:45685 every 8 connection(s)
I20260929 06:42:04.559966 2712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:42:04 dist-test-slave-ltw5 krb5kdc[2605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664124, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.129@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:04.568526 2690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.560676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:60991 (local address 127.15.157.190:42319)
0929 06:42:04.560722 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:04.560724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:04.560930 (+ 206us) server_negotiation.cc:407] Connection header received
0929 06:42:04.561369 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:04.561370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:04.561379 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:04.561439 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:04.562399 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.562907 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.563830 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.564020 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.564070 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.566051 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:04.566053 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:04.566054 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:04.566062 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:04.567448 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:04.567782 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:04.567783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:04.567783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:04.567831 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:04.568030 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:04.568031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:04.568031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:04.568126 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:04.568174 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:04.568401 (+ 227us) server_negotiation.cc:299] Negotiation successful
0929 06:42:04.568461 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:42:04.568717 2843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.560627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:42319 (local address 127.15.157.129:60991)
0929 06:42:04.560785 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:04.560836 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:04.561286 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:04.561493 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:04.561496 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:04.562124 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:04.562316 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.562321 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.562988 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.562989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.563752 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.563754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.564092 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.564092 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.564189 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.564635 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:04.564642 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:04.565930 (+ 1288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:04.567516 (+ 1586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:04.567522 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:04.567523 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:04.567717 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:04.567888 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:04.567888 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:04.567889 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:04.567977 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:04.568179 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:04.568183 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:04.568296 (+ 113us) client_negotiation.cc:769] Sending connection context
0929 06:42:04.568373 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 06:42:04.568482 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":92,"threads_started":1}
I20260929 06:42:04.569223 2841 heartbeater.cc:347] Connected to a master server at 127.15.157.190:42319
I20260929 06:42:04.569348 2841 heartbeater.cc:464] Registering TS with master...
I20260929 06:42:04.569402 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 2712
I20260929 06:42:04.569494 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:42:04.569535 2841 heartbeater.cc:511] Master 127.15.157.190:42319 requested a full tablet report, sending...
I20260929 06:42:04.569645 15990 external_mini_cluster.cc:1428] Setting key a4b681cd73a06489b241c43e56f7545c
I20260929 06:42:04.570161 2650 ts_manager.cc:194] Registered new tserver with Master: 89b47f6ce3e94ac18c253a05287d0266 (127.15.157.129:45685)
I20260929 06:42:04.570843 2650 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.129@KRBTEST.COM'} at 127.15.157.129:60991
WARNING: no policy specified for kudu/127.15.157.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
Entry for principal kudu/127.15.157.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab.
I20260929 06:42:04.592449 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:42319
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:04.672821 2846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:04.673023 2846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:04.673045 2846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:04.674168 2846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:04.674204 2846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:04.674229 2846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:42:04.675572 2846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.130.keytab
--principal=kudu/127.15.157.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:42319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:04.675748 2846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:04.675917 2846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:42:04.680994 2846 server_base.cc:1034] running on GCE node
W20260929 06:42:04.680971 2852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:04.680963 2851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:04.680963 2854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:04.681355 2846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:04.681597 2846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:04.682760 2846 hybrid_clock.cc:648] HybridClock initialized: now 1790664124682747 us; error 45 us; skew 500 ppm
Sep 29 06:42:04 dist-test-slave-ltw5 krb5kdc[2605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664124, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:04.685163 2846 init.cc:377] Logged in from keytab as kudu/127.15.157.130@KRBTEST.COM (short username kudu)
I20260929 06:42:04.685632 2846 webserver.cc:460] Webserver started at http://127.15.157.130:33741/ using document root <none> and password file <none>
I20260929 06:42:04.685847 2846 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:04.685914 2846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:04.686089 2846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:04.687152 2846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "2facd1c01b9f41be86ed625b9966f3eb"
format_stamp: "Formatted at 2026-09-29 06:42:04 on dist-test-slave-ltw5"
server_key: "46d3426240cbfab9ec9b6dcaa99c5e87"
server_key_iv: "d78bf96b8d6f5795fd536cc369dda87a"
server_key_version: "encryptionkey@0"
I20260929 06:42:04.687512 2846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "2facd1c01b9f41be86ed625b9966f3eb"
format_stamp: "Formatted at 2026-09-29 06:42:04 on dist-test-slave-ltw5"
server_key: "46d3426240cbfab9ec9b6dcaa99c5e87"
server_key_iv: "d78bf96b8d6f5795fd536cc369dda87a"
server_key_version: "encryptionkey@0"
I20260929 06:42:04.688778 2846 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:42:04.689476 2861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:04.689675 2846 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:42:04.689787 2846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "2facd1c01b9f41be86ed625b9966f3eb"
format_stamp: "Formatted at 2026-09-29 06:42:04 on dist-test-slave-ltw5"
server_key: "46d3426240cbfab9ec9b6dcaa99c5e87"
server_key_iv: "d78bf96b8d6f5795fd536cc369dda87a"
server_key_version: "encryptionkey@0"
I20260929 06:42:04.689869 2846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:04.708108 2846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:04.710474 2846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:04.710639 2846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:04.710879 2846 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:42:04.711196 2846 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:42:04.711251 2846 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:04.711293 2846 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:42:04.711320 2846 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:04.717164 2846 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:34779
I20260929 06:42:04.717206 2974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:34779 every 8 connection(s)
I20260929 06:42:04.717517 2846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:42:04 dist-test-slave-ltw5 krb5kdc[2605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664124, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.130@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:04.726747 2690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.718211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:35741 (local address 127.15.157.190:42319)
0929 06:42:04.718280 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:04.718283 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:04.718479 (+ 196us) server_negotiation.cc:407] Connection header received
0929 06:42:04.719065 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:04.719087 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:04.719101 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:04.719152 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:04.720095 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.720687 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.721719 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.721959 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.722076 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.724128 (+ 2052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:04.724129 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:04.724129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:04.724137 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:04.725331 (+ 1194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:04.725754 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:04.725756 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:04.725756 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:04.725818 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:04.726104 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:04.726105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:04.726106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:04.726224 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:04.726301 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:04.726568 (+ 267us) server_negotiation.cc:299] Negotiation successful
0929 06:42:04.726652 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 06:42:04.726964 2977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.718186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:42319 (local address 127.15.157.130:35741)
0929 06:42:04.718342 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:04.718389 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:04.718943 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:04.719222 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:04.719226 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:04.719792 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:04.719980 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.719984 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.720767 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.720768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.721622 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.721624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.722055 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.722056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.722193 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.722661 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:04.722669 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:04.724014 (+ 1345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:04.725415 (+ 1401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:04.725423 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:04.725425 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:04.725673 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:04.725887 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:04.725888 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:04.725889 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:04.725993 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:04.726290 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:04.726297 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:04.726436 (+ 139us) client_negotiation.cc:769] Sending connection context
0929 06:42:04.726547 (+ 111us) client_negotiation.cc:240] Negotiation successful
0929 06:42:04.726714 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
I20260929 06:42:04.727159 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 2846
I20260929 06:42:04.727278 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:42:04.727507 15990 external_mini_cluster.cc:1428] Setting key 6cf968486ae1d093c6b147e083b674ad
I20260929 06:42:04.727519 2975 heartbeater.cc:347] Connected to a master server at 127.15.157.190:42319
I20260929 06:42:04.727612 2975 heartbeater.cc:464] Registering TS with master...
I20260929 06:42:04.727789 2975 heartbeater.cc:511] Master 127.15.157.190:42319 requested a full tablet report, sending...
I20260929 06:42:04.728196 2650 ts_manager.cc:194] Registered new tserver with Master: 2facd1c01b9f41be86ed625b9966f3eb (127.15.157.130:34779)
I20260929 06:42:04.728708 2650 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.130@KRBTEST.COM'} at 127.15.157.130:35741
WARNING: no policy specified for kudu/127.15.157.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
Entry for principal kudu/127.15.157.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab.
I20260929 06:42:04.750943 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:42319
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:33425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:04.830752 2980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:04.830956 2980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:04.830979 2980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:04.832077 2980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:04.832114 2980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:04.832140 2980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:42:04.833498 2980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:33425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.131.keytab
--principal=kudu/127.15.157.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:42319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:04.833696 2980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:04.833879 2980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:42:04.839033 2980 server_base.cc:1034] running on GCE node
W20260929 06:42:04.838979 2985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:04.838977 2988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:04.838987 2986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:04.839339 2980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:04.839541 2980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:04.840694 2980 hybrid_clock.cc:648] HybridClock initialized: now 1790664124840679 us; error 64 us; skew 500 ppm
Sep 29 06:42:04 dist-test-slave-ltw5 krb5kdc[2605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664124, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:04.843076 2980 init.cc:377] Logged in from keytab as kudu/127.15.157.131@KRBTEST.COM (short username kudu)
I20260929 06:42:04.843513 2980 webserver.cc:460] Webserver started at http://127.15.157.131:46035/ using document root <none> and password file <none>
I20260929 06:42:04.843777 2980 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:04.843849 2980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:04.843997 2980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:04.845022 2980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "d287d97765aa4e75b0c059a2543696a6"
format_stamp: "Formatted at 2026-09-29 06:42:04 on dist-test-slave-ltw5"
server_key: "de57654f1a85789d0f63f8b4b47b4a49"
server_key_iv: "4ba9030241d75686a977b3119efd5451"
server_key_version: "encryptionkey@0"
I20260929 06:42:04.845382 2980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "d287d97765aa4e75b0c059a2543696a6"
format_stamp: "Formatted at 2026-09-29 06:42:04 on dist-test-slave-ltw5"
server_key: "de57654f1a85789d0f63f8b4b47b4a49"
server_key_iv: "4ba9030241d75686a977b3119efd5451"
server_key_version: "encryptionkey@0"
I20260929 06:42:04.846761 2980 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:42:04.847453 2995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:04.847654 2980 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:42:04.847769 2980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "d287d97765aa4e75b0c059a2543696a6"
format_stamp: "Formatted at 2026-09-29 06:42:04 on dist-test-slave-ltw5"
server_key: "de57654f1a85789d0f63f8b4b47b4a49"
server_key_iv: "4ba9030241d75686a977b3119efd5451"
server_key_version: "encryptionkey@0"
I20260929 06:42:04.847867 2980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:04.856374 2980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:04.858232 2980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:04.858393 2980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:04.858628 2980 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:42:04.858951 2980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:42:04.859009 2980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:04.859050 2980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:42:04.859078 2980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:04.865032 2980 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:42617
I20260929 06:42:04.865083 3108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:42617 every 8 connection(s)
I20260929 06:42:04.865401 2980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:42:04.865715 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 2980
I20260929 06:42:04.865850 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:42:04.866065 15990 external_mini_cluster.cc:1428] Setting key f47d4f6530af52b72549d29e9e516063
Sep 29 06:42:04 dist-test-slave-ltw5 krb5kdc[2605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664124, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.131@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:04.874802 2690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.866382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:33871 (local address 127.15.157.190:42319)
0929 06:42:04.866437 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:04.866440 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:04.866676 (+ 236us) server_negotiation.cc:407] Connection header received
0929 06:42:04.867232 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:04.867233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:04.867243 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:04.867288 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:04.868175 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.868663 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.869615 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.869794 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.869843 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.871917 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:04.871919 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:04.871920 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:04.871927 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:04.873352 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:04.873781 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:04.873782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:04.873783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:04.873844 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:04.874137 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:04.874138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:04.874138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:04.874260 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:04.874351 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:04.874626 (+ 275us) server_negotiation.cc:299] Negotiation successful
0929 06:42:04.874708 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 06:42:04.875005 3111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.866387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:42319 (local address 127.15.157.131:33871)
0929 06:42:04.866560 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:04.866600 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:04.867141 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:04.867343 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:04.867346 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:04.867909 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:04.868098 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.868102 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.868754 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.868755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.869537 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.869539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.869865 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.869866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.869962 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.870456 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:04.870464 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:04.871814 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:04.873456 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:04.873463 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:04.873465 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:04.873700 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:04.873911 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:04.873912 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:04.873912 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:04.874075 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:04.874343 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:04.874349 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:04.874489 (+ 140us) client_negotiation.cc:769] Sending connection context
0929 06:42:04.874603 (+ 114us) client_negotiation.cc:240] Negotiation successful
0929 06:42:04.874758 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":105,"threads_started":1}
I20260929 06:42:04.875494 3109 heartbeater.cc:347] Connected to a master server at 127.15.157.190:42319
I20260929 06:42:04.875612 3109 heartbeater.cc:464] Registering TS with master...
I20260929 06:42:04.875797 3109 heartbeater.cc:511] Master 127.15.157.190:42319 requested a full tablet report, sending...
I20260929 06:42:04.876199 2650 ts_manager.cc:194] Registered new tserver with Master: d287d97765aa4e75b0c059a2543696a6 (127.15.157.131:42617)
I20260929 06:42:04.876581 2650 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.157.131@KRBTEST.COM'} at 127.15.157.131:33871
I20260929 06:42:04.877744 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:42:04.884820 2690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.879071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55304 (local address 127.15.157.190:42319)
0929 06:42:04.879133 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:04.879136 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:04.879207 (+ 71us) server_negotiation.cc:407] Connection header received
0929 06:42:04.879301 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:04.879302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:04.879311 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:04.879365 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:04.879907 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.880377 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.881117 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.881325 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.881407 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.882559 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:04.882560 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:04.882561 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:04.882567 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:04.883638 (+ 1071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:04.883992 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:04.883993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:04.883993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:04.884053 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:04.884248 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:04.884249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:04.884249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:04.884396 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:04.884497 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:04.884647 (+ 150us) server_negotiation.cc:299] Negotiation successful
0929 06:42:04.884722 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 06:42:04.886353 2650 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55304:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:42:04.887909 2650 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:42:04.894207 3119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.889894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:34779 (local address 127.0.0.1:39996)
0929 06:42:04.890605 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:04.890611 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:04.890664 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:04.890858 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:04.890858 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:04.890860 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:04.890904 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.890905 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.891734 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.891735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.892908 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.892911 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.893879 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.893880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.893958 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.893975 (+ 17us) client_negotiation.cc:769] Sending connection context
0929 06:42:04.894070 (+ 95us) client_negotiation.cc:240] Negotiation successful
0929 06:42:04.894128 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"spinlock_wait_cycles":768,"thread_start_us":71,"threads_started":1}
I20260929 06:42:04.894310 3122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.890343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54342 (local address 127.15.157.129:45685)
0929 06:42:04.890521 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:04.890525 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:04.890537 (+ 12us) server_negotiation.cc:407] Connection header received
0929 06:42:04.890605 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:04.890607 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:04.890623 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:04.890696 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:04.891070 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.892106 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.893300 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.893930 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.894005 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.894097 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:04.894170 (+ 73us) server_negotiation.cc:299] Negotiation successful
0929 06:42:04.894205 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":80,"threads_started":1}
I20260929 06:42:04.894543 3120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.890138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50756 (local address 127.15.157.131:42617)
0929 06:42:04.890325 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:04.890330 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:04.890339 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:42:04.890382 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:04.890384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:04.890396 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:04.890848 (+ 452us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:04.890912 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.892004 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.893323 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.894068 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.894362 (+ 294us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.894422 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:04.894446 (+ 24us) server_negotiation.cc:299] Negotiation successful
0929 06:42:04.894489 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":93,"threads_started":1}
I20260929 06:42:04.894718 3121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.890144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39996 (local address 127.15.157.130:34779)
0929 06:42:04.890359 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:04.890364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:04.890666 (+ 302us) server_negotiation.cc:407] Connection header received
0929 06:42:04.890734 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:04.890736 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:04.890750 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:04.890859 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:04.890969 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.891628 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.892997 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.893791 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.893867 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.893920 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:04.894580 (+ 660us) server_negotiation.cc:299] Negotiation successful
0929 06:42:04.894638 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":119,"threads_started":1}
I20260929 06:42:04.894377 3117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.889868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:42617 (local address 127.0.0.1:50756)
0929 06:42:04.889971 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:04.890008 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:04.890093 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:04.890528 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:04.890532 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:04.890535 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:04.890766 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.890769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.892118 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.892119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.893220 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.893223 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.894163 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.894163 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.894212 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.894215 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:42:04.894256 (+ 41us) client_negotiation.cc:240] Negotiation successful
0929 06:42:04.894288 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":1,"thread_start_us":57,"threads_started":1}
I20260929 06:42:04.894315 3118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.889893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:45685 (local address 127.0.0.1:54342)
0929 06:42:04.890494 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:04.890503 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:04.890547 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:04.890889 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:04.890890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:04.890892 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:04.890941 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.890943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.892203 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.892204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.893207 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.893209 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.894006 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.894007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.894089 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.894093 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:42:04.894157 (+ 64us) client_negotiation.cc:240] Negotiation successful
0929 06:42:04.894196 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"mutex_wait_us":3,"thread_start_us":70,"threads_started":1}
I20260929 06:42:04.895505 3043 tablet_service.cc:1467] Processing CreateTablet for tablet f308a5fa4f7a47888a6b8f557868fad5 (DEFAULT_TABLE table=test-table [id=76328b8772804bbdb7194d725b1b9a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:04.895586 2909 tablet_service.cc:1467] Processing CreateTablet for tablet f308a5fa4f7a47888a6b8f557868fad5 (DEFAULT_TABLE table=test-table [id=76328b8772804bbdb7194d725b1b9a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:04.895833 3043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f308a5fa4f7a47888a6b8f557868fad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:04.895989 2909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f308a5fa4f7a47888a6b8f557868fad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:04.898468 3123 tablet_bootstrap.cc:492] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6: Bootstrap starting.
I20260929 06:42:04.898684 2775 tablet_service.cc:1467] Processing CreateTablet for tablet f308a5fa4f7a47888a6b8f557868fad5 (DEFAULT_TABLE table=test-table [id=76328b8772804bbdb7194d725b1b9a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:04.899004 2775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f308a5fa4f7a47888a6b8f557868fad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:04.899113 3123 tablet_bootstrap.cc:654] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:04.899585 3123 log.cc:824] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:04.900295 3123 tablet_bootstrap.cc:492] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6: No bootstrap required, opened a new log
I20260929 06:42:04.900380 3123 ts_tablet_manager.cc:1397] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:42:04.901804 3126 tablet_bootstrap.cc:492] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266: Bootstrap starting.
I20260929 06:42:04.901952 3123 raft_consensus.cc:348] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d287d97765aa4e75b0c059a2543696a6" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 42617 } } peers { permanent_uuid: "2facd1c01b9f41be86ed625b9966f3eb" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34779 } } peers { permanent_uuid: "89b47f6ce3e94ac18c253a05287d0266" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45685 } }
I20260929 06:42:04.902086 3124 tablet_bootstrap.cc:492] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb: Bootstrap starting.
I20260929 06:42:04.902164 3123 raft_consensus.cc:374] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:04.902211 3123 raft_consensus.cc:729] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d287d97765aa4e75b0c059a2543696a6, State: Initialized, Role: FOLLOWER
I20260929 06:42:04.902328 3123 consensus_queue.cc:260] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d287d97765aa4e75b0c059a2543696a6" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 42617 } } peers { permanent_uuid: "2facd1c01b9f41be86ed625b9966f3eb" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34779 } } peers { permanent_uuid: "89b47f6ce3e94ac18c253a05287d0266" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45685 } }
I20260929 06:42:04.902475 3126 tablet_bootstrap.cc:654] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:04.902601 3123 ts_tablet_manager.cc:1428] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:42:04.902716 3124 tablet_bootstrap.cc:654] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:04.902736 3109 heartbeater.cc:503] Master 127.15.157.190:42319 was elected leader, sending a full tablet report...
I20260929 06:42:04.903119 3126 log.cc:824] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:04.903285 3124 log.cc:824] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:04.903932 3126 tablet_bootstrap.cc:492] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266: No bootstrap required, opened a new log
I20260929 06:42:04.903937 3124 tablet_bootstrap.cc:492] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb: No bootstrap required, opened a new log
I20260929 06:42:04.904003 3126 ts_tablet_manager.cc:1397] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:42:04.904004 3124 ts_tablet_manager.cc:1397] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:42:04.905934 3124 raft_consensus.cc:348] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d287d97765aa4e75b0c059a2543696a6" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 42617 } } peers { permanent_uuid: "2facd1c01b9f41be86ed625b9966f3eb" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34779 } } peers { permanent_uuid: "89b47f6ce3e94ac18c253a05287d0266" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45685 } }
I20260929 06:42:04.905930 3126 raft_consensus.cc:348] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d287d97765aa4e75b0c059a2543696a6" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 42617 } } peers { permanent_uuid: "2facd1c01b9f41be86ed625b9966f3eb" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34779 } } peers { permanent_uuid: "89b47f6ce3e94ac18c253a05287d0266" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45685 } }
I20260929 06:42:04.906133 3124 raft_consensus.cc:374] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:04.906133 3126 raft_consensus.cc:374] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:04.906174 3124 raft_consensus.cc:729] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2facd1c01b9f41be86ed625b9966f3eb, State: Initialized, Role: FOLLOWER
I20260929 06:42:04.906174 3126 raft_consensus.cc:729] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89b47f6ce3e94ac18c253a05287d0266, State: Initialized, Role: FOLLOWER
I20260929 06:42:04.906289 3126 consensus_queue.cc:260] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d287d97765aa4e75b0c059a2543696a6" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 42617 } } peers { permanent_uuid: "2facd1c01b9f41be86ed625b9966f3eb" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34779 } } peers { permanent_uuid: "89b47f6ce3e94ac18c253a05287d0266" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45685 } }
I20260929 06:42:04.906304 3124 consensus_queue.cc:260] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d287d97765aa4e75b0c059a2543696a6" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 42617 } } peers { permanent_uuid: "2facd1c01b9f41be86ed625b9966f3eb" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34779 } } peers { permanent_uuid: "89b47f6ce3e94ac18c253a05287d0266" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45685 } }
I20260929 06:42:04.906562 3124 ts_tablet_manager.cc:1428] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:42:04.906562 3126 ts_tablet_manager.cc:1428] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:42:04.906579 2841 heartbeater.cc:503] Master 127.15.157.190:42319 was elected leader, sending a full tablet report...
I20260929 06:42:04.906716 2975 heartbeater.cc:503] Master 127.15.157.190:42319 was elected leader, sending a full tablet report...
I20260929 06:42:04.967844 3130 raft_consensus.cc:482] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:42:04.967962 3130 raft_consensus.cc:504] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d287d97765aa4e75b0c059a2543696a6" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 42617 } } peers { permanent_uuid: "2facd1c01b9f41be86ed625b9966f3eb" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34779 } } peers { permanent_uuid: "89b47f6ce3e94ac18c253a05287d0266" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45685 } }
W20260929 06:42:04.968055 2976 tablet.cc:2369] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:42:04.968389 3130 leader_election.cc:288] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d287d97765aa4e75b0c059a2543696a6 (127.15.157.131:42617), 2facd1c01b9f41be86ed625b9966f3eb (127.15.157.130:34779)
I20260929 06:42:04.971345 3121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.968651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:35213 (local address 127.15.157.130:34779)
0929 06:42:04.968695 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:04.968698 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:04.968708 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:42:04.968757 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:04.968758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:04.968769 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:04.968840 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:04.969016 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.969536 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.970605 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.970988 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.971045 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.971052 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:04.971227 (+ 175us) server_negotiation.cc:299] Negotiation successful
0929 06:42:04.971271 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:42:04.971393 3120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.968688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:36625 (local address 127.15.157.131:42617)
0929 06:42:04.968734 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:04.968737 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:04.968848 (+ 111us) server_negotiation.cc:407] Connection header received
0929 06:42:04.968883 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:04.968884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:04.968894 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:04.968956 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:04.969135 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.969619 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.970630 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.971010 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.971104 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.971113 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:04.971281 (+ 168us) server_negotiation.cc:299] Negotiation successful
0929 06:42:04.971330 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:42:04.971380 2843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.968571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:34779 (local address 127.15.157.129:35213)
0929 06:42:04.968619 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:04.968631 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:04.968678 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:04.968863 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:04.968865 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:04.968867 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:04.968945 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.968947 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.969616 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.969617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.970518 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.970520 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.971069 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.971070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.971150 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.971154 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:42:04.971204 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 06:42:04.971260 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":25}
I20260929 06:42:04.971398 3132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.968574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:42617 (local address 127.15.157.129:36625)
0929 06:42:04.968773 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:04.968783 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:04.968838 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:04.968993 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:04.968994 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:04.968996 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:04.969066 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.969068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.969703 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.969704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.970524 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:04.970526 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.971123 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.971124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:04.971176 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.971179 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:42:04.971256 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 06:42:04.971292 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":13,"thread_start_us":110,"threads_started":1}
I20260929 06:42:04.971787 2929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f308a5fa4f7a47888a6b8f557868fad5" candidate_uuid: "89b47f6ce3e94ac18c253a05287d0266" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2facd1c01b9f41be86ed625b9966f3eb" is_pre_election: true
I20260929 06:42:04.971807 3063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f308a5fa4f7a47888a6b8f557868fad5" candidate_uuid: "89b47f6ce3e94ac18c253a05287d0266" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d287d97765aa4e75b0c059a2543696a6" is_pre_election: true
I20260929 06:42:04.971923 3063 raft_consensus.cc:2454] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89b47f6ce3e94ac18c253a05287d0266 in term 0.
I20260929 06:42:04.971932 2929 raft_consensus.cc:2454] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89b47f6ce3e94ac18c253a05287d0266 in term 0.
I20260929 06:42:04.972147 2729 leader_election.cc:302] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2facd1c01b9f41be86ed625b9966f3eb, 89b47f6ce3e94ac18c253a05287d0266; no voters:
I20260929 06:42:04.972295 3130 raft_consensus.cc:2781] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:42:04.972378 3130 raft_consensus.cc:482] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:42:04.972414 3130 raft_consensus.cc:3037] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:04.973107 3130 raft_consensus.cc:504] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d287d97765aa4e75b0c059a2543696a6" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 42617 } } peers { permanent_uuid: "2facd1c01b9f41be86ed625b9966f3eb" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34779 } } peers { permanent_uuid: "89b47f6ce3e94ac18c253a05287d0266" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45685 } }
I20260929 06:42:04.973270 3130 leader_election.cc:288] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [CANDIDATE]: Term 1 election: Requested vote from peers d287d97765aa4e75b0c059a2543696a6 (127.15.157.131:42617), 2facd1c01b9f41be86ed625b9966f3eb (127.15.157.130:34779)
I20260929 06:42:04.973394 3063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f308a5fa4f7a47888a6b8f557868fad5" candidate_uuid: "89b47f6ce3e94ac18c253a05287d0266" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d287d97765aa4e75b0c059a2543696a6"
I20260929 06:42:04.973428 2929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f308a5fa4f7a47888a6b8f557868fad5" candidate_uuid: "89b47f6ce3e94ac18c253a05287d0266" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2facd1c01b9f41be86ed625b9966f3eb"
I20260929 06:42:04.973467 3063 raft_consensus.cc:3037] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:04.973505 2929 raft_consensus.cc:3037] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:04.974272 2929 raft_consensus.cc:2454] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89b47f6ce3e94ac18c253a05287d0266 in term 1.
I20260929 06:42:04.974334 3063 raft_consensus.cc:2454] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89b47f6ce3e94ac18c253a05287d0266 in term 1.
I20260929 06:42:04.974551 2730 leader_election.cc:302] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89b47f6ce3e94ac18c253a05287d0266, d287d97765aa4e75b0c059a2543696a6; no voters:
I20260929 06:42:04.974647 3130 raft_consensus.cc:2781] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:04.974789 3130 raft_consensus.cc:686] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [term 1 LEADER]: Becoming Leader. State: Replica: 89b47f6ce3e94ac18c253a05287d0266, State: Running, Role: LEADER
I20260929 06:42:04.974884 3130 consensus_queue.cc:237] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d287d97765aa4e75b0c059a2543696a6" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 42617 } } peers { permanent_uuid: "2facd1c01b9f41be86ed625b9966f3eb" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34779 } } peers { permanent_uuid: "89b47f6ce3e94ac18c253a05287d0266" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45685 } }
I20260929 06:42:04.975777 2649 catalog_manager.cc:5495] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89b47f6ce3e94ac18c253a05287d0266 (127.15.157.129). New cstate: current_term: 1 leader_uuid: "89b47f6ce3e94ac18c253a05287d0266" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d287d97765aa4e75b0c059a2543696a6" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 42617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2facd1c01b9f41be86ed625b9966f3eb" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89b47f6ce3e94ac18c253a05287d0266" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 45685 } health_report { overall_health: HEALTHY } } }
I20260929 06:42:04.988283 3122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:04.986212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54358 (local address 127.15.157.129:45685)
0929 06:42:04.986281 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:04.986282 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:04.986301 (+ 19us) server_negotiation.cc:407] Connection header received
0929 06:42:04.986328 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:04.986328 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:04.986345 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:04.986396 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:04.986505 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.986949 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.987627 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:04.987808 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:04.987856 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:04.987975 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:04.988061 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:04.988114 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:04.988149 (+ 35us) server_negotiation.cc:299] Negotiation successful
0929 06:42:04.988163 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260929 06:42:04.989953 2929 raft_consensus.cc:1261] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb [term 1 FOLLOWER]: Refusing update from remote peer 89b47f6ce3e94ac18c253a05287d0266: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:42:04.989959 3063 raft_consensus.cc:1261] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6 [term 1 FOLLOWER]: Refusing update from remote peer 89b47f6ce3e94ac18c253a05287d0266: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:42:04.990360 3133 consensus_queue.cc:1035] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d287d97765aa4e75b0c059a2543696a6" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 42617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:42:04.990476 3130 consensus_queue.cc:1035] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2facd1c01b9f41be86ed625b9966f3eb" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:42:04.993235 3138 mvcc.cc:205] Tried to move back new op lower bound from 7334560255956242432 to 7334560255897751552. Current Snapshot: MvccSnapshot[applied={T|T < 7334560255956242432}]
I20260929 06:42:04.993660 3137 mvcc.cc:205] Tried to move back new op lower bound from 7334560255956242432 to 7334560255897751552. Current Snapshot: MvccSnapshot[applied={T|T < 7334560255956242432 or (T in {7334560255956242432})}]
I20260929 06:42:04.995569 2650 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55304:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:42:04.995674 2650 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55304:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:42:04.996366 2650 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac3a94e544a44e368af93a0cd40979b0: Sending DeleteTablet for 3 replicas of tablet f308a5fa4f7a47888a6b8f557868fad5
I20260929 06:42:04.996724 2909 tablet_service.cc:1514] Processing DeleteTablet for tablet f308a5fa4f7a47888a6b8f557868fad5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:04 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:39996
I20260929 06:42:04.996855 3043 tablet_service.cc:1514] Processing DeleteTablet for tablet f308a5fa4f7a47888a6b8f557868fad5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:04 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:50756
I20260929 06:42:04.996943 2775 tablet_service.cc:1514] Processing DeleteTablet for tablet f308a5fa4f7a47888a6b8f557868fad5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:04 UTC) from {username='kudu', principal='kudu/127.15.157.190@KRBTEST.COM'} at 127.0.0.1:54342
I20260929 06:42:04.997069 3146 tablet_replica.cc:330] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6: stopping tablet replica
I20260929 06:42:04.997139 3147 tablet_replica.cc:330] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266: stopping tablet replica
I20260929 06:42:04.997161 3146 raft_consensus.cc:2229] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:42:04.997224 3147 raft_consensus.cc:2229] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:42:04.997268 3146 raft_consensus.cc:2258] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:42:04.997308 3147 raft_consensus.cc:2258] T f308a5fa4f7a47888a6b8f557868fad5 P 89b47f6ce3e94ac18c253a05287d0266 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:42:04.997339 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 2712
I20260929 06:42:04.997816 3145 tablet_replica.cc:330] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb: stopping tablet replica
I20260929 06:42:04.997905 3145 raft_consensus.cc:2229] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:42:04.997996 3145 raft_consensus.cc:2258] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:42:04.998585 3146 ts_tablet_manager.cc:1905] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:42:04.998585 3145 ts_tablet_manager.cc:1905] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:42:05.000516 3146 ts_tablet_manager.cc:1918] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:42:05.000516 3145 ts_tablet_manager.cc:1918] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:42:05.000595 3145 log.cc:1196] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/f308a5fa4f7a47888a6b8f557868fad5
I20260929 06:42:05.000595 3146 log.cc:1196] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/f308a5fa4f7a47888a6b8f557868fad5
I20260929 06:42:05.000880 3146 ts_tablet_manager.cc:1939] T f308a5fa4f7a47888a6b8f557868fad5 P d287d97765aa4e75b0c059a2543696a6: Deleting consensus metadata
I20260929 06:42:05.000880 3145 ts_tablet_manager.cc:1939] T f308a5fa4f7a47888a6b8f557868fad5 P 2facd1c01b9f41be86ed625b9966f3eb: Deleting consensus metadata
I20260929 06:42:05.001253 2636 catalog_manager.cc:4841] TS d287d97765aa4e75b0c059a2543696a6 (127.15.157.131:42617): tablet f308a5fa4f7a47888a6b8f557868fad5 (table test-table [id=76328b8772804bbdb7194d725b1b9a3a]) successfully deleted
I20260929 06:42:05.001309 2635 catalog_manager.cc:4841] TS 2facd1c01b9f41be86ed625b9966f3eb (127.15.157.130:34779): tablet f308a5fa4f7a47888a6b8f557868fad5 (table test-table [id=76328b8772804bbdb7194d725b1b9a3a]) successfully deleted
W20260929 06:42:05.003118 2634 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:45685 (error 108)
I20260929 06:42:05.003539 3118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.003432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:45685 (local address 127.0.0.1:54368)
0929 06:42:05.003482 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:05.003515 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:45685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260929 06:42:05.003644 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 2846
W20260929 06:42:05.003659 2634 catalog_manager.cc:4584] TS 89b47f6ce3e94ac18c253a05287d0266 (127.15.157.129:45685): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f308a5fa4f7a47888a6b8f557868fad5: Network error: Client connection negotiation failed: client connection to 127.15.157.129:45685: connect: Connection refused (error 111)
I20260929 06:42:05.009179 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 2980
I20260929 06:42:05.013468 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 2618
2026-09-29T06:42:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (1917 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-09-29T06:42:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:05Z Disabled control of system clock
I20260929 06:42:05.040449 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:33757
--webserver_interface=127.15.157.190
--webserver_port=0
--builtin_ntp_servers=127.15.157.148:44035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:33757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:42:05.119472 3152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:05.119691 3152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:05.119712 3152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:05.120797 3152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:05.120831 3152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:05.120846 3152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:05.120857 3152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:05.120869 3152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:05.122596 3152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:44035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:33757
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:33757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:05.122807 3152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:05.123050 3152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:05.127790 3158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:05.127799 3160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:05.127856 3157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:05.128057 3152 server_base.cc:1034] running on GCE node
I20260929 06:42:05.128334 3152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:05.128623 3152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:05.129783 3152 hybrid_clock.cc:648] HybridClock initialized: now 1790664125129756 us; error 38 us; skew 500 ppm
I20260929 06:42:05.131153 3152 webserver.cc:460] Webserver started at http://127.15.157.190:36129/ using document root <none> and password file <none>
I20260929 06:42:05.131400 3152 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:05.131448 3152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:05.131601 3152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:05.132704 3152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "0884d8f5968b42adaa660c194b4ec9ae"
format_stamp: "Formatted at 2026-09-29 06:42:05 on dist-test-slave-ltw5"
server_key: "54a619cee0266bd649d6cbbda02cb136"
server_key_iv: "7b64c88a7f93d97e90013849ab4ecc00"
server_key_version: "encryptionkey@0"
I20260929 06:42:05.133067 3152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "0884d8f5968b42adaa660c194b4ec9ae"
format_stamp: "Formatted at 2026-09-29 06:42:05 on dist-test-slave-ltw5"
server_key: "54a619cee0266bd649d6cbbda02cb136"
server_key_iv: "7b64c88a7f93d97e90013849ab4ecc00"
server_key_version: "encryptionkey@0"
I20260929 06:42:05.134534 3152 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:42:05.135267 3166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:05.135456 3152 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:42:05.135528 3152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "0884d8f5968b42adaa660c194b4ec9ae"
format_stamp: "Formatted at 2026-09-29 06:42:05 on dist-test-slave-ltw5"
server_key: "54a619cee0266bd649d6cbbda02cb136"
server_key_iv: "7b64c88a7f93d97e90013849ab4ecc00"
server_key_version: "encryptionkey@0"
I20260929 06:42:05.135617 3152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:05.170008 3152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:05.170424 3152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:05.170578 3152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:05.174481 3152 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:33757
I20260929 06:42:05.174536 3218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:33757 every 8 connection(s)
I20260929 06:42:05.174888 3152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:05.175843 3219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:05.178143 3219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae: Bootstrap starting.
I20260929 06:42:05.178736 3219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:05.179035 3219 log.cc:824] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:05.179679 3219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae: No bootstrap required, opened a new log
I20260929 06:42:05.181205 3219 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0884d8f5968b42adaa660c194b4ec9ae" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 33757 } }
I20260929 06:42:05.181347 3219 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:05.181397 3219 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0884d8f5968b42adaa660c194b4ec9ae, State: Initialized, Role: FOLLOWER
I20260929 06:42:05.181545 3219 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0884d8f5968b42adaa660c194b4ec9ae" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 33757 } }
I20260929 06:42:05.181615 3219 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:05.181636 3219 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:05.181707 3219 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:05.182268 3219 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0884d8f5968b42adaa660c194b4ec9ae" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 33757 } }
I20260929 06:42:05.182382 3219 leader_election.cc:302] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0884d8f5968b42adaa660c194b4ec9ae; no voters:
I20260929 06:42:05.182561 3219 leader_election.cc:288] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:05.182607 3222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:05.182790 3222 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [term 1 LEADER]: Becoming Leader. State: Replica: 0884d8f5968b42adaa660c194b4ec9ae, State: Running, Role: LEADER
I20260929 06:42:05.182839 3219 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:05.182910 3222 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0884d8f5968b42adaa660c194b4ec9ae" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 33757 } }
I20260929 06:42:05.183320 3224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0884d8f5968b42adaa660c194b4ec9ae. Latest consensus state: current_term: 1 leader_uuid: "0884d8f5968b42adaa660c194b4ec9ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0884d8f5968b42adaa660c194b4ec9ae" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 33757 } } }
I20260929 06:42:05.183406 3224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:05.183523 3223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0884d8f5968b42adaa660c194b4ec9ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0884d8f5968b42adaa660c194b4ec9ae" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 33757 } } }
I20260929 06:42:05.183624 3231 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:05.184185 3231 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:05.183645 3223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:05.185020 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 3152
I20260929 06:42:05.185135 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:05.185353 15990 external_mini_cluster.cc:1428] Setting key 7e8c33e4ca0c41fc63fce1978a069b1c
I20260929 06:42:05.186429 3231 catalog_manager.cc:1347] Generated new cluster ID: 071b13f0cf1b4afd99e39c3160948891
I20260929 06:42:05.186482 3231 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:05.194438 3231 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:05.195109 3231 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:05.195477 3242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.185831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44908 (local address 127.15.157.190:33757)
0929 06:42:05.186036 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:05.186045 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:05.186105 (+ 60us) server_negotiation.cc:407] Connection header received
0929 06:42:05.186219 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:05.186225 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:05.186303 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:05.186435 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:05.190357 (+ 3922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.192058 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.193128 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.193780 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.194061 (+ 281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.194772 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:05.194775 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:05.194776 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:05.194953 (+ 177us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:05.194988 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:05.194998 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:05.195069 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:05.195148 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 06:42:05.195252 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":77,"threads_started":1}
I20260929 06:42:05.199193 3231 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae: Generated new TSK 0
I20260929 06:42:05.199384 3231 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:05.201459 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.129:0
--local_ip_for_outbound_sockets=127.15.157.129
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:33757
--builtin_ntp_servers=127.15.157.148:44035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:42:05.301373 3243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:05.301574 3243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:05.301595 3243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:05.302779 3243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:05.302819 3243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:05.302842 3243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.129
I20260929 06:42:05.304204 3243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:44035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.157.129
--webserver_port=0
--tserver_master_addrs=127.15.157.190:33757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.129
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:05.304461 3243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:05.304760 3243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:05.309585 3249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:05.309605 3243 server_base.cc:1034] running on GCE node
W20260929 06:42:05.309760 3248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:05.309861 3251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:05.310148 3243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:05.310422 3243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:05.311579 3243 hybrid_clock.cc:648] HybridClock initialized: now 1790664125311568 us; error 28 us; skew 500 ppm
I20260929 06:42:05.312873 3243 webserver.cc:460] Webserver started at http://127.15.157.129:36121/ using document root <none> and password file <none>
I20260929 06:42:05.313122 3243 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:05.313191 3243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:05.313340 3243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:05.314499 3243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/data/instance:
uuid: "d7de522e459149e2aad2e544b4df5ce5"
format_stamp: "Formatted at 2026-09-29 06:42:05 on dist-test-slave-ltw5"
server_key: "36bdbc425d69f1826507f98c003bdaac"
server_key_iv: "ac1a3c210e4671313fc3bb0c1424e24f"
server_key_version: "encryptionkey@0"
I20260929 06:42:05.314990 3243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance:
uuid: "d7de522e459149e2aad2e544b4df5ce5"
format_stamp: "Formatted at 2026-09-29 06:42:05 on dist-test-slave-ltw5"
server_key: "36bdbc425d69f1826507f98c003bdaac"
server_key_iv: "ac1a3c210e4671313fc3bb0c1424e24f"
server_key_version: "encryptionkey@0"
I20260929 06:42:05.316344 3243 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:42:05.317096 3257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:05.317353 3243 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:05.317451 3243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/wal
uuid: "d7de522e459149e2aad2e544b4df5ce5"
format_stamp: "Formatted at 2026-09-29 06:42:05 on dist-test-slave-ltw5"
server_key: "36bdbc425d69f1826507f98c003bdaac"
server_key_iv: "ac1a3c210e4671313fc3bb0c1424e24f"
server_key_version: "encryptionkey@0"
I20260929 06:42:05.317525 3243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:05.332185 3243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:05.332499 3243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:05.332688 3243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:05.332957 3243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:42:05.333376 3243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:42:05.333422 3243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:05.333452 3243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:42:05.333468 3243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:05.340708 3243 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.129:43619
I20260929 06:42:05.340807 3370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.129:43619 every 8 connection(s)
I20260929 06:42:05.341100 3243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/data/info.pb
I20260929 06:42:05.346541 3242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.341809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.129:53167 (local address 127.15.157.190:33757)
0929 06:42:05.341852 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:05.341855 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:05.342161 (+ 306us) server_negotiation.cc:407] Connection header received
0929 06:42:05.342699 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:05.342700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:05.342712 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:05.342764 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:05.343445 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.343959 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.344999 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.345216 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.345296 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.346210 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:05.346211 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:05.346212 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:05.346217 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:05.346232 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:05.346237 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:05.346307 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:05.346422 (+ 115us) server_negotiation.cc:299] Negotiation successful
0929 06:42:05.346457 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:42:05.346748 3373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.341806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:33757 (local address 127.15.157.129:53167)
0929 06:42:05.341989 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:05.342059 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:05.342586 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:05.342849 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:05.342853 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:05.342869 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:05.343351 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.343356 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.344062 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.344064 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.344907 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.344910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.345304 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.345306 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.345437 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.346002 (+ 565us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:42:05.346003 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:05.346082 (+ 79us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:42:05.346111 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:05.346307 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:05.346314 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:05.346317 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:42:05.346416 (+ 99us) client_negotiation.cc:240] Negotiation successful
0929 06:42:05.346520 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":74,"threads_started":1}
I20260929 06:42:05.347074 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 3243
I20260929 06:42:05.347203 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-0/wal/instance
I20260929 06:42:05.347352 3371 heartbeater.cc:347] Connected to a master server at 127.15.157.190:33757
I20260929 06:42:05.347412 15990 external_mini_cluster.cc:1428] Setting key 1c9796687743dba84f2dd3a62a11f086
I20260929 06:42:05.347450 3371 heartbeater.cc:464] Registering TS with master...
I20260929 06:42:05.347676 3371 heartbeater.cc:511] Master 127.15.157.190:33757 requested a full tablet report, sending...
I20260929 06:42:05.348240 3183 ts_manager.cc:194] Registered new tserver with Master: d7de522e459149e2aad2e544b4df5ce5 (127.15.157.129:43619)
I20260929 06:42:05.348399 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.130:0
--local_ip_for_outbound_sockets=127.15.157.130
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:33757
--builtin_ntp_servers=127.15.157.148:44035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260929 06:42:05.349125 3183 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.157.129:53167
W20260929 06:42:05.428246 3374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:05.428488 3374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:05.428522 3374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:05.429656 3374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:05.429723 3374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:05.429765 3374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.130
I20260929 06:42:05.431133 3374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:44035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.157.130
--webserver_port=0
--tserver_master_addrs=127.15.157.190:33757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.130
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:05.431411 3374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:05.431712 3374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:05.436719 3379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:05.436697 3380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:05.436712 3382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:05.437081 3374 server_base.cc:1034] running on GCE node
I20260929 06:42:05.437282 3374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:05.437485 3374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:05.438618 3374 hybrid_clock.cc:648] HybridClock initialized: now 1790664125438604 us; error 28 us; skew 500 ppm
I20260929 06:42:05.439805 3374 webserver.cc:460] Webserver started at http://127.15.157.130:43263/ using document root <none> and password file <none>
I20260929 06:42:05.440050 3374 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:05.440095 3374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:05.440259 3374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:05.441349 3374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/data/instance:
uuid: "b5889f4836b74623b14cb4ac9e1b5c60"
format_stamp: "Formatted at 2026-09-29 06:42:05 on dist-test-slave-ltw5"
server_key: "a595625ee62d0299283c69e4ba26c9da"
server_key_iv: "f24d727f4c650dc9f9dab6c18a5490c5"
server_key_version: "encryptionkey@0"
I20260929 06:42:05.441701 3374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance:
uuid: "b5889f4836b74623b14cb4ac9e1b5c60"
format_stamp: "Formatted at 2026-09-29 06:42:05 on dist-test-slave-ltw5"
server_key: "a595625ee62d0299283c69e4ba26c9da"
server_key_iv: "f24d727f4c650dc9f9dab6c18a5490c5"
server_key_version: "encryptionkey@0"
I20260929 06:42:05.443025 3374 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:42:05.443804 3388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:05.443981 3374 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:42:05.444073 3374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/wal
uuid: "b5889f4836b74623b14cb4ac9e1b5c60"
format_stamp: "Formatted at 2026-09-29 06:42:05 on dist-test-slave-ltw5"
server_key: "a595625ee62d0299283c69e4ba26c9da"
server_key_iv: "f24d727f4c650dc9f9dab6c18a5490c5"
server_key_version: "encryptionkey@0"
I20260929 06:42:05.444149 3374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:05.456130 3374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:05.456458 3374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:05.456614 3374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:05.456836 3374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:42:05.457185 3374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:42:05.457239 3374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:05.457283 3374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:42:05.457309 3374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:05.463492 3374 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.130:34319
I20260929 06:42:05.465587 3501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.130:34319 every 8 connection(s)
I20260929 06:42:05.466562 3374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/data/info.pb
I20260929 06:42:05.472373 3242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.467370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:40835 (local address 127.15.157.190:33757)
0929 06:42:05.467431 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:05.467433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:05.467739 (+ 306us) server_negotiation.cc:407] Connection header received
0929 06:42:05.468376 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:05.468377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:05.468412 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:05.468462 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:05.469386 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.470098 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.471161 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.471347 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.471405 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.472161 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:05.472163 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:05.472163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:05.472167 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:05.472181 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:05.472185 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:05.472236 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:05.472286 (+ 50us) server_negotiation.cc:299] Negotiation successful
0929 06:42:05.472312 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 06:42:05.472589 3504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.467363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:33757 (local address 127.15.157.130:40835)
0929 06:42:05.467579 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:05.467635 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:05.468270 (+ 635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:05.468551 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:05.468555 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:05.468563 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:05.469235 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.469241 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.470202 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.470203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.471081 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.471084 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.471426 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.471427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.471534 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.472035 (+ 501us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:42:05.472036 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:05.472063 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:42:05.472085 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:05.472237 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:05.472239 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:05.472242 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:42:05.472298 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 06:42:05.472372 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":91,"threads_started":1}
I20260929 06:42:05.472978 3502 heartbeater.cc:347] Connected to a master server at 127.15.157.190:33757
I20260929 06:42:05.473088 3502 heartbeater.cc:464] Registering TS with master...
I20260929 06:42:05.473290 3502 heartbeater.cc:511] Master 127.15.157.190:33757 requested a full tablet report, sending...
I20260929 06:42:05.473721 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 3374
I20260929 06:42:05.473812 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/wal/instance
I20260929 06:42:05.473956 15990 external_mini_cluster.cc:1428] Setting key 8fbf4874cc0728b3021643ce900ce3f0
I20260929 06:42:05.474207 3183 ts_manager.cc:194] Registered new tserver with Master: b5889f4836b74623b14cb4ac9e1b5c60 (127.15.157.130:34319)
I20260929 06:42:05.474849 3183 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.157.130:40835
I20260929 06:42:05.475082 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.157.131:0
--local_ip_for_outbound_sockets=127.15.157.131
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:33757
--builtin_ntp_servers=127.15.157.148:44035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:42:05.558461 3505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:05.558760 3505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:05.558786 3505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:05.560025 3505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:05.560077 3505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:05.560105 3505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.157.131
I20260929 06:42:05.561501 3505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:44035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.157.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.157.131
--webserver_port=0
--tserver_master_addrs=127.15.157.190:33757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.157.131
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:05.561709 3505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:05.561964 3505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:05.566936 3511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:05.566936 3513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:05.567016 3510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:05.567154 3505 server_base.cc:1034] running on GCE node
I20260929 06:42:05.567379 3505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:05.567615 3505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:05.568784 3505 hybrid_clock.cc:648] HybridClock initialized: now 1790664125568781 us; error 38 us; skew 500 ppm
I20260929 06:42:05.570463 3505 webserver.cc:460] Webserver started at http://127.15.157.131:41083/ using document root <none> and password file <none>
I20260929 06:42:05.570713 3505 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:05.570793 3505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:05.570953 3505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:05.572028 3505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/data/instance:
uuid: "392c142688214e03adae1ab7acba27f3"
format_stamp: "Formatted at 2026-09-29 06:42:05 on dist-test-slave-ltw5"
server_key: "eff167bf30cb78a2655101e9833f4f97"
server_key_iv: "d8f286eb68430cbbfa73ce5d747daabc"
server_key_version: "encryptionkey@0"
I20260929 06:42:05.572417 3505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance:
uuid: "392c142688214e03adae1ab7acba27f3"
format_stamp: "Formatted at 2026-09-29 06:42:05 on dist-test-slave-ltw5"
server_key: "eff167bf30cb78a2655101e9833f4f97"
server_key_iv: "d8f286eb68430cbbfa73ce5d747daabc"
server_key_version: "encryptionkey@0"
I20260929 06:42:05.573789 3505 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:42:05.574710 3519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:05.574922 3505 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:42:05.575027 3505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/wal
uuid: "392c142688214e03adae1ab7acba27f3"
format_stamp: "Formatted at 2026-09-29 06:42:05 on dist-test-slave-ltw5"
server_key: "eff167bf30cb78a2655101e9833f4f97"
server_key_iv: "d8f286eb68430cbbfa73ce5d747daabc"
server_key_version: "encryptionkey@0"
I20260929 06:42:05.575124 3505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:05.585435 3505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:05.585774 3505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:05.585935 3505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:05.586218 3505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:42:05.586553 3505 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:42:05.586611 3505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:05.586653 3505 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:42:05.586683 3505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:05.592552 3505 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.131:35091
I20260929 06:42:05.592622 3632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.131:35091 every 8 connection(s)
I20260929 06:42:05.592979 3505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/data/info.pb
I20260929 06:42:05.598335 3242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.593787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.131:58673 (local address 127.15.157.190:33757)
0929 06:42:05.593865 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:05.593868 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:05.594167 (+ 299us) server_negotiation.cc:407] Connection header received
0929 06:42:05.594669 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:05.594670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:05.594680 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:05.594730 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:05.595409 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.595900 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.596888 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.597078 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.597131 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.598092 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:05.598093 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:05.598093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:05.598098 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:05.598111 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:05.598115 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:05.598166 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:05.598255 (+ 89us) server_negotiation.cc:299] Negotiation successful
0929 06:42:05.598275 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:42:05.598542 3635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.593788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:33757 (local address 127.15.157.131:58673)
0929 06:42:05.593985 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:05.594071 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:05.594574 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:05.594792 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:05.594796 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:05.594804 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:05.595311 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.595315 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.595999 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.596000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.596808 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.596810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.597158 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.597159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.597271 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.597899 (+ 628us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:42:05.597899 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:05.597936 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:42:05.597960 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:05.598181 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:05.598185 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:05.598187 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:42:05.598242 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 06:42:05.598320 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260929 06:42:05.599109 3633 heartbeater.cc:347] Connected to a master server at 127.15.157.190:33757
I20260929 06:42:05.599215 3633 heartbeater.cc:464] Registering TS with master...
I20260929 06:42:05.599391 3633 heartbeater.cc:511] Master 127.15.157.190:33757 requested a full tablet report, sending...
I20260929 06:42:05.599748 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 3505
I20260929 06:42:05.599874 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/wal/instance
I20260929 06:42:05.599871 3183 ts_manager.cc:194] Registered new tserver with Master: 392c142688214e03adae1ab7acba27f3 (127.15.157.131:35091)
I20260929 06:42:05.600081 15990 external_mini_cluster.cc:1428] Setting key c5db4d951ae152884f7b2bc3a91565bd
I20260929 06:42:05.600332 3183 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.157.131:58673
I20260929 06:42:05.601006 15990 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:42:05.605327 3242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.602398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44920 (local address 127.15.157.190:33757)
0929 06:42:05.602456 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:05.602458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:05.602532 (+ 74us) server_negotiation.cc:407] Connection header received
0929 06:42:05.602607 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:05.602608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:05.602618 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:05.602672 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:05.602854 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.603322 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.604073 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.604283 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.604372 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.605036 (+ 664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:05.605037 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:05.605038 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:05.605043 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:05.605056 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:05.605060 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:05.605142 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:05.605204 (+ 62us) server_negotiation.cc:299] Negotiation successful
0929 06:42:05.605230 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 06:42:05.607044 3183 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44920:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:42:05.608554 3183 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:42:05.614663 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.610971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:43619 (local address 127.0.0.1:42542)
0929 06:42:05.611293 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:05.611303 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:05.611372 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:05.611750 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:05.611751 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:05.611753 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:05.611792 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.611793 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.612650 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.612651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.613594 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.613596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.614357 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.614358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.614445 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.614460 (+ 15us) client_negotiation.cc:769] Sending connection context
0929 06:42:05.614533 (+ 73us) client_negotiation.cc:240] Negotiation successful
0929 06:42:05.614590 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":1,"thread_start_us":72,"threads_started":1}
I20260929 06:42:05.614675 3646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.611094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42542 (local address 127.15.157.129:43619)
0929 06:42:05.611265 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:05.611268 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:05.611371 (+ 103us) server_negotiation.cc:407] Connection header received
0929 06:42:05.611517 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:05.611519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:05.611533 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:05.611684 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:05.611886 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.612540 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.613682 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.614263 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.614350 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.614442 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:05.614547 (+ 105us) server_negotiation.cc:299] Negotiation successful
0929 06:42:05.614589 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":88,"threads_started":1}
I20260929 06:42:05.615443 3645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.610767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:35091 (local address 127.0.0.1:37252)
0929 06:42:05.611293 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:05.611303 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:05.611372 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:05.611648 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:05.611651 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:05.611654 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:05.611719 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.611721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.613030 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.613031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.614317 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.614319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.615203 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.615205 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.615264 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.615269 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:42:05.615337 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 06:42:05.615377 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":93,"thread_start_us":56,"threads_started":1}
I20260929 06:42:05.615487 3643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.610843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37252 (local address 127.15.157.131:35091)
0929 06:42:05.611152 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:05.611156 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:05.611371 (+ 215us) server_negotiation.cc:407] Connection header received
0929 06:42:05.611458 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:05.611460 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:05.611478 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:05.611567 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:05.611783 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.612934 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.614412 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.615116 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.615199 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.615282 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:05.615348 (+ 66us) server_negotiation.cc:299] Negotiation successful
0929 06:42:05.615385 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":114,"threads_started":1}
I20260929 06:42:05.615603 3644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.610872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37514 (local address 127.15.157.130:34319)
0929 06:42:05.611065 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:05.611070 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:05.611244 (+ 174us) server_negotiation.cc:407] Connection header received
0929 06:42:05.611560 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:05.611563 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:05.611581 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:05.611633 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:05.611865 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.612940 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.614420 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.615120 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.615168 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.615247 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:05.615466 (+ 219us) server_negotiation.cc:299] Negotiation successful
0929 06:42:05.615512 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":85,"threads_started":1}
I20260929 06:42:05.615836 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.610767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.130:34319 (local address 127.0.0.1:37514)
0929 06:42:05.611131 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:05.611175 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:05.611462 (+ 287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:05.611737 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:05.611738 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:05.611739 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:05.611786 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.611787 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.613030 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.613031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.614317 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.614319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.615312 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.615313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.615379 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.615382 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:42:05.615704 (+ 322us) client_negotiation.cc:240] Negotiation successful
0929 06:42:05.615766 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":54,"thread_start_us":77,"threads_started":1}
I20260929 06:42:05.615756 3305 tablet_service.cc:1467] Processing CreateTablet for tablet 4103f354462a4b1ba4f9ab39b2394409 (DEFAULT_TABLE table=test-table [id=42974f6e1d0f4369b16d922c18571cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:05.616132 3305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4103f354462a4b1ba4f9ab39b2394409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:05.616519 3436 tablet_service.cc:1467] Processing CreateTablet for tablet 4103f354462a4b1ba4f9ab39b2394409 (DEFAULT_TABLE table=test-table [id=42974f6e1d0f4369b16d922c18571cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:05.616858 3436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4103f354462a4b1ba4f9ab39b2394409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:05.617123 3567 tablet_service.cc:1467] Processing CreateTablet for tablet 4103f354462a4b1ba4f9ab39b2394409 (DEFAULT_TABLE table=test-table [id=42974f6e1d0f4369b16d922c18571cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:42:05.617446 3567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4103f354462a4b1ba4f9ab39b2394409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:05.619406 3648 tablet_bootstrap.cc:492] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60: Bootstrap starting.
I20260929 06:42:05.620018 3648 tablet_bootstrap.cc:654] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:05.620321 3648 log.cc:824] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:05.620491 3649 tablet_bootstrap.cc:492] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3: Bootstrap starting.
I20260929 06:42:05.620685 3647 tablet_bootstrap.cc:492] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5: Bootstrap starting.
I20260929 06:42:05.621114 3649 tablet_bootstrap.cc:654] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:05.621305 3647 tablet_bootstrap.cc:654] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:05.621392 3649 log.cc:824] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:05.621624 3647 log.cc:824] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:05.622169 3649 tablet_bootstrap.cc:492] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3: No bootstrap required, opened a new log
I20260929 06:42:05.622241 3649 ts_tablet_manager.cc:1397] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:42:05.622357 3648 tablet_bootstrap.cc:492] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60: No bootstrap required, opened a new log
I20260929 06:42:05.622416 3648 ts_tablet_manager.cc:1397] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260929 06:42:05.622463 3647 tablet_bootstrap.cc:492] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5: No bootstrap required, opened a new log
I20260929 06:42:05.622537 3647 ts_tablet_manager.cc:1397] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:42:05.624545 3647 raft_consensus.cc:348] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34319 } } peers { permanent_uuid: "392c142688214e03adae1ab7acba27f3" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35091 } } peers { permanent_uuid: "d7de522e459149e2aad2e544b4df5ce5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43619 } }
I20260929 06:42:05.624702 3647 raft_consensus.cc:374] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:05.624745 3647 raft_consensus.cc:729] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7de522e459149e2aad2e544b4df5ce5, State: Initialized, Role: FOLLOWER
I20260929 06:42:05.624876 3647 consensus_queue.cc:260] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34319 } } peers { permanent_uuid: "392c142688214e03adae1ab7acba27f3" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35091 } } peers { permanent_uuid: "d7de522e459149e2aad2e544b4df5ce5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43619 } }
I20260929 06:42:05.625015 3648 raft_consensus.cc:348] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34319 } } peers { permanent_uuid: "392c142688214e03adae1ab7acba27f3" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35091 } } peers { permanent_uuid: "d7de522e459149e2aad2e544b4df5ce5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43619 } }
I20260929 06:42:05.625015 3649 raft_consensus.cc:348] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34319 } } peers { permanent_uuid: "392c142688214e03adae1ab7acba27f3" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35091 } } peers { permanent_uuid: "d7de522e459149e2aad2e544b4df5ce5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43619 } }
I20260929 06:42:05.625133 3647 ts_tablet_manager.cc:1428] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:42:05.625178 3649 raft_consensus.cc:374] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:05.625178 3648 raft_consensus.cc:374] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:05.625214 3649 raft_consensus.cc:729] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 392c142688214e03adae1ab7acba27f3, State: Initialized, Role: FOLLOWER
I20260929 06:42:05.625216 3648 raft_consensus.cc:729] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5889f4836b74623b14cb4ac9e1b5c60, State: Initialized, Role: FOLLOWER
I20260929 06:42:05.625267 3371 heartbeater.cc:503] Master 127.15.157.190:33757 was elected leader, sending a full tablet report...
I20260929 06:42:05.625330 3649 consensus_queue.cc:260] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34319 } } peers { permanent_uuid: "392c142688214e03adae1ab7acba27f3" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35091 } } peers { permanent_uuid: "d7de522e459149e2aad2e544b4df5ce5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43619 } }
I20260929 06:42:05.625330 3648 consensus_queue.cc:260] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34319 } } peers { permanent_uuid: "392c142688214e03adae1ab7acba27f3" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35091 } } peers { permanent_uuid: "d7de522e459149e2aad2e544b4df5ce5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43619 } }
I20260929 06:42:05.625572 3648 ts_tablet_manager.cc:1428] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:42:05.625572 3649 ts_tablet_manager.cc:1428] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:42:05.625635 3502 heartbeater.cc:503] Master 127.15.157.190:33757 was elected leader, sending a full tablet report...
I20260929 06:42:05.625864 3633 heartbeater.cc:503] Master 127.15.157.190:33757 was elected leader, sending a full tablet report...
W20260929 06:42:05.718580 3503 tablet.cc:2369] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:42:05.774243 3654 raft_consensus.cc:482] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:42:05.774382 3654 raft_consensus.cc:504] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34319 } } peers { permanent_uuid: "392c142688214e03adae1ab7acba27f3" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35091 } } peers { permanent_uuid: "d7de522e459149e2aad2e544b4df5ce5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43619 } }
I20260929 06:42:05.774741 3654 leader_election.cc:288] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 392c142688214e03adae1ab7acba27f3 (127.15.157.131:35091), d7de522e459149e2aad2e544b4df5ce5 (127.15.157.129:43619)
I20260929 06:42:05.777806 3646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.775180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:34553 (local address 127.15.157.129:43619)
0929 06:42:05.775229 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:05.775231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:05.775346 (+ 115us) server_negotiation.cc:407] Connection header received
0929 06:42:05.775399 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:05.775400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:05.775412 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:05.775469 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:05.775624 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.776108 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.777055 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.777426 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.777492 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.777522 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:05.777678 (+ 156us) server_negotiation.cc:299] Negotiation successful
0929 06:42:05.777724 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 06:42:05.777828 3643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.775023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.157.130:39275 (local address 127.15.157.131:35091)
0929 06:42:05.775093 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:05.775095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:05.775108 (+ 13us) server_negotiation.cc:407] Connection header received
0929 06:42:05.775142 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:05.775143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:05.775152 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:05.775274 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:42:05.775491 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.776020 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.777095 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.777442 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.777529 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.777536 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:05.777713 (+ 177us) server_negotiation.cc:299] Negotiation successful
0929 06:42:05.777750 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:42:05.777889 3656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.775062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:43619 (local address 127.15.157.130:34553)
0929 06:42:05.775268 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:05.775279 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:05.775340 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:05.775485 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:05.775485 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:05.775487 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:05.775554 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.775555 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.776188 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.776188 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.776961 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.776962 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.777517 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.777518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.777603 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.777607 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:42:05.777649 (+ 42us) client_negotiation.cc:240] Negotiation successful
0929 06:42:05.777708 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":1,"thread_start_us":129,"threads_started":1}
I20260929 06:42:05.777887 3504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.774931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.131:35091 (local address 127.15.157.130:39275)
0929 06:42:05.774996 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:05.775009 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:05.775058 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:05.775291 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:05.775295 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:05.775298 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:42:05.775391 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.775393 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.776100 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.776101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.776968 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:05.776970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.777546 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.777546 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:05.777613 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.777615 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:42:05.777707 (+ 92us) client_negotiation.cc:240] Negotiation successful
0929 06:42:05.777743 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":48}
I20260929 06:42:05.778299 3325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4103f354462a4b1ba4f9ab39b2394409" candidate_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7de522e459149e2aad2e544b4df5ce5" is_pre_election: true
I20260929 06:42:05.778481 3325 raft_consensus.cc:2454] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5889f4836b74623b14cb4ac9e1b5c60 in term 0.
I20260929 06:42:05.778554 3587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4103f354462a4b1ba4f9ab39b2394409" candidate_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "392c142688214e03adae1ab7acba27f3" is_pre_election: true
I20260929 06:42:05.778692 3587 raft_consensus.cc:2454] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5889f4836b74623b14cb4ac9e1b5c60 in term 0.
I20260929 06:42:05.778718 3390 leader_election.cc:302] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5889f4836b74623b14cb4ac9e1b5c60, d7de522e459149e2aad2e544b4df5ce5; no voters:
I20260929 06:42:05.778868 3654 raft_consensus.cc:2781] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:42:05.778931 3654 raft_consensus.cc:482] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:42:05.778949 3654 raft_consensus.cc:3037] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:05.779742 3654 raft_consensus.cc:504] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34319 } } peers { permanent_uuid: "392c142688214e03adae1ab7acba27f3" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35091 } } peers { permanent_uuid: "d7de522e459149e2aad2e544b4df5ce5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43619 } }
I20260929 06:42:05.779877 3654 leader_election.cc:288] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [CANDIDATE]: Term 1 election: Requested vote from peers 392c142688214e03adae1ab7acba27f3 (127.15.157.131:35091), d7de522e459149e2aad2e544b4df5ce5 (127.15.157.129:43619)
I20260929 06:42:05.780062 3325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4103f354462a4b1ba4f9ab39b2394409" candidate_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7de522e459149e2aad2e544b4df5ce5"
I20260929 06:42:05.780062 3587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4103f354462a4b1ba4f9ab39b2394409" candidate_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "392c142688214e03adae1ab7acba27f3"
I20260929 06:42:05.780136 3587 raft_consensus.cc:3037] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:05.780136 3325 raft_consensus.cc:3037] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:05.781024 3587 raft_consensus.cc:2454] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5889f4836b74623b14cb4ac9e1b5c60 in term 1.
I20260929 06:42:05.781024 3325 raft_consensus.cc:2454] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5889f4836b74623b14cb4ac9e1b5c60 in term 1.
I20260929 06:42:05.781180 3390 leader_election.cc:302] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 392c142688214e03adae1ab7acba27f3, b5889f4836b74623b14cb4ac9e1b5c60; no voters:
I20260929 06:42:05.781276 3654 raft_consensus.cc:2781] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:05.781418 3654 raft_consensus.cc:686] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [term 1 LEADER]: Becoming Leader. State: Replica: b5889f4836b74623b14cb4ac9e1b5c60, State: Running, Role: LEADER
I20260929 06:42:05.781514 3654 consensus_queue.cc:237] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34319 } } peers { permanent_uuid: "392c142688214e03adae1ab7acba27f3" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35091 } } peers { permanent_uuid: "d7de522e459149e2aad2e544b4df5ce5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43619 } }
I20260929 06:42:05.782318 3183 catalog_manager.cc:5495] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5889f4836b74623b14cb4ac9e1b5c60 (127.15.157.130). New cstate: current_term: 1 leader_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5889f4836b74623b14cb4ac9e1b5c60" member_type: VOTER last_known_addr { host: "127.15.157.130" port: 34319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "392c142688214e03adae1ab7acba27f3" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7de522e459149e2aad2e544b4df5ce5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43619 } health_report { overall_health: UNKNOWN } } }
I20260929 06:42:05.797516 3644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.795094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37522 (local address 127.15.157.130:34319)
0929 06:42:05.795160 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:05.795163 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:05.795189 (+ 26us) server_negotiation.cc:407] Connection header received
0929 06:42:05.795236 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:05.795237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:05.795255 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:05.795333 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:05.795468 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.795957 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.796730 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:05.796921 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:05.796999 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:05.797167 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:05.797270 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:05.797366 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:05.797384 (+ 18us) server_negotiation.cc:299] Negotiation successful
0929 06:42:05.797406 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 06:42:05.799680 3587 raft_consensus.cc:1261] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3 [term 1 FOLLOWER]: Refusing update from remote peer b5889f4836b74623b14cb4ac9e1b5c60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:42:05.799710 3325 raft_consensus.cc:1261] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5 [term 1 FOLLOWER]: Refusing update from remote peer b5889f4836b74623b14cb4ac9e1b5c60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:42:05.800000 3654 consensus_queue.cc:1035] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "392c142688214e03adae1ab7acba27f3" member_type: VOTER last_known_addr { host: "127.15.157.131" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:42:05.800151 3657 consensus_queue.cc:1035] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7de522e459149e2aad2e544b4df5ce5" member_type: VOTER last_known_addr { host: "127.15.157.129" port: 43619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:42:05.803444 3662 mvcc.cc:205] Tried to move back new op lower bound from 7334560259272626176 to 7334560259201724416. Current Snapshot: MvccSnapshot[applied={T|T < 7334560259272626176}]
I20260929 06:42:05.805516 3183 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:42:05.805613 3183 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:42:05.806383 3183 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0884d8f5968b42adaa660c194b4ec9ae: Sending DeleteTablet for 3 replicas of tablet 4103f354462a4b1ba4f9ab39b2394409
I20260929 06:42:05.806725 3436 tablet_service.cc:1514] Processing DeleteTablet for tablet 4103f354462a4b1ba4f9ab39b2394409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:05 UTC) from {username='slave'} at 127.0.0.1:37514
I20260929 06:42:05.806792 3567 tablet_service.cc:1514] Processing DeleteTablet for tablet 4103f354462a4b1ba4f9ab39b2394409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:05 UTC) from {username='slave'} at 127.0.0.1:37252
I20260929 06:42:05.806855 3305 tablet_service.cc:1514] Processing DeleteTablet for tablet 4103f354462a4b1ba4f9ab39b2394409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:42:05 UTC) from {username='slave'} at 127.0.0.1:42542
I20260929 06:42:05.806995 3670 tablet_replica.cc:330] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3: stopping tablet replica
I20260929 06:42:05.807097 3670 raft_consensus.cc:2229] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:42:05.807214 3670 raft_consensus.cc:2258] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:42:05.807128 3671 tablet_replica.cc:330] T 4103f354462a4b1ba4f9ab39b2394409 P d7de522e459149e2aad2e544b4df5ce5: stopping tablet replica
I20260929 06:42:05.807216 3669 tablet_replica.cc:330] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60: stopping tablet replica
I20260929 06:42:05.807425 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 3243
I20260929 06:42:05.807665 3670 ts_tablet_manager.cc:1905] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:42:05.808151 3669 raft_consensus.cc:2229] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:42:05.808358 3669 raft_consensus.cc:2258] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:42:05.808862 3669 ts_tablet_manager.cc:1905] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:42:05.809713 3670 ts_tablet_manager.cc:1918] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:42:05.809805 3670 log.cc:1196] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-2/wal/wals/4103f354462a4b1ba4f9ab39b2394409
I20260929 06:42:05.810101 3670 ts_tablet_manager.cc:1939] T 4103f354462a4b1ba4f9ab39b2394409 P 392c142688214e03adae1ab7acba27f3: Deleting consensus metadata
I20260929 06:42:05.810503 3168 catalog_manager.cc:4841] TS 392c142688214e03adae1ab7acba27f3 (127.15.157.131:35091): tablet 4103f354462a4b1ba4f9ab39b2394409 (table test-table [id=42974f6e1d0f4369b16d922c18571cc3]) successfully deleted
I20260929 06:42:05.810817 3669 ts_tablet_manager.cc:1918] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:42:05.810904 3669 log.cc:1196] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60: Deleting WAL directory at /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663890058284-15990-0/minicluster-data/ts-1/wal/wals/4103f354462a4b1ba4f9ab39b2394409
I20260929 06:42:05.811131 3669 ts_tablet_manager.cc:1939] T 4103f354462a4b1ba4f9ab39b2394409 P b5889f4836b74623b14cb4ac9e1b5c60: Deleting consensus metadata
I20260929 06:42:05.811498 3167 catalog_manager.cc:4841] TS b5889f4836b74623b14cb4ac9e1b5c60 (127.15.157.130:34319): tablet 4103f354462a4b1ba4f9ab39b2394409 (table test-table [id=42974f6e1d0f4369b16d922c18571cc3]) successfully deleted
W20260929 06:42:05.815459 3168 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.157.129:43619 (error 108)
I20260929 06:42:05.815716 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 3374
I20260929 06:42:05.816438 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:05.815826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.129:43619 (local address 127.0.0.1:42548)
0929 06:42:05.816354 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:05.816396 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.129:43619: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":507}
W20260929 06:42:05.818053 3168 catalog_manager.cc:4584] TS d7de522e459149e2aad2e544b4df5ce5 (127.15.157.129:43619): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4103f354462a4b1ba4f9ab39b2394409: Network error: Client connection negotiation failed: client connection to 127.15.157.129:43619: connect: Connection refused (error 111)
I20260929 06:42:05.820703 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 3505
I20260929 06:42:05.825151 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 3152
2026-09-29T06:42:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (811 ms)
[----------] 6 tests from EncryptionPolicyTest (8222 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:05 dist-test-slave-ltw5 krb5kdc[3675](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:05 dist-test-slave-ltw5 krb5kdc[3675](info): set up 2 sockets
Sep 29 06:42:05 dist-test-slave-ltw5 krb5kdc[3675](info): commencing operation
krb5kdc: starting...
W20260929 06:42:06.862033 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:06 dist-test-slave-ltw5 krb5kdc[3675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:42:06.981297 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46351
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46351
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:07.062397 3688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:07.062608 3688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:07.062630 3688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:07.063825 3688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:07.063870 3688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:07.063884 3688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:07.063897 3688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:07.063910 3688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:07.065407 3688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46351
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:07.065680 3688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:07.065918 3688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:07.070762 3693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:07.070770 3694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:07.070916 3688 server_base.cc:1034] running on GCE node
W20260929 06:42:07.070762 3696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:07.071329 3688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:07.071631 3688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:07.072800 3688 hybrid_clock.cc:648] HybridClock initialized: now 1790664127072796 us; error 38 us; skew 500 ppm
Sep 29 06:42:07 dist-test-slave-ltw5 krb5kdc[3675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664127, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:07.075311 3688 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:42:07.075750 3688 webserver.cc:460] Webserver started at http://127.0.0.1:33617/ using document root <none> and password file <none>
I20260929 06:42:07.075971 3688 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:07.076040 3688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:07.076189 3688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:07.077312 3688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "08ce65fe5dd3484faf65f9c62b5abe88"
format_stamp: "Formatted at 2026-09-29 06:42:07 on dist-test-slave-ltw5"
server_key: "e0a239430b4848902881b848625d82cb"
server_key_iv: "c34c75341508cfde5318d159c40dcb4a"
server_key_version: "encryptionkey@0"
I20260929 06:42:07.077682 3688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "08ce65fe5dd3484faf65f9c62b5abe88"
format_stamp: "Formatted at 2026-09-29 06:42:07 on dist-test-slave-ltw5"
server_key: "e0a239430b4848902881b848625d82cb"
server_key_iv: "c34c75341508cfde5318d159c40dcb4a"
server_key_version: "encryptionkey@0"
I20260929 06:42:07.079135 3688 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:42:07.079933 3703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:07.080171 3688 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:42:07.080286 3688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "08ce65fe5dd3484faf65f9c62b5abe88"
format_stamp: "Formatted at 2026-09-29 06:42:07 on dist-test-slave-ltw5"
server_key: "e0a239430b4848902881b848625d82cb"
server_key_iv: "c34c75341508cfde5318d159c40dcb4a"
server_key_version: "encryptionkey@0"
I20260929 06:42:07.080363 3688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:07.095872 3688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:07.097997 3688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:07.098245 3688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:07.102097 3688 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46351
I20260929 06:42:07.102146 3755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46351 every 8 connection(s)
I20260929 06:42:07.102521 3688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:07.103371 3756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:07.105618 3756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88: Bootstrap starting.
I20260929 06:42:07.105932 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 3688
I20260929 06:42:07.106086 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:07.106282 15990 external_mini_cluster.cc:1428] Setting key ca881369216262ba02ab92624877a8e1
I20260929 06:42:07.106316 3756 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:07.106634 3756 log.cc:824] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:07.107384 3756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88: No bootstrap required, opened a new log
I20260929 06:42:07.109725 3756 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08ce65fe5dd3484faf65f9c62b5abe88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46351 } }
I20260929 06:42:07.109894 3756 raft_consensus.cc:374] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:07.109925 3756 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08ce65fe5dd3484faf65f9c62b5abe88, State: Initialized, Role: FOLLOWER
I20260929 06:42:07.110070 3756 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08ce65fe5dd3484faf65f9c62b5abe88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46351 } }
I20260929 06:42:07.110184 3756 raft_consensus.cc:388] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:07.110235 3756 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:07.110286 3756 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:07.110806 3756 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08ce65fe5dd3484faf65f9c62b5abe88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46351 } }
I20260929 06:42:07.110937 3756 leader_election.cc:302] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 08ce65fe5dd3484faf65f9c62b5abe88; no voters:
I20260929 06:42:07.111073 3756 leader_election.cc:288] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:07.111124 3761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:07.111281 3761 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [term 1 LEADER]: Becoming Leader. State: Replica: 08ce65fe5dd3484faf65f9c62b5abe88, State: Running, Role: LEADER
I20260929 06:42:07.111308 3756 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:07.111385 3761 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08ce65fe5dd3484faf65f9c62b5abe88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46351 } }
I20260929 06:42:07.111711 3761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08ce65fe5dd3484faf65f9c62b5abe88. Latest consensus state: current_term: 1 leader_uuid: "08ce65fe5dd3484faf65f9c62b5abe88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08ce65fe5dd3484faf65f9c62b5abe88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46351 } } }
I20260929 06:42:07.111814 3761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:07.111720 3762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08ce65fe5dd3484faf65f9c62b5abe88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08ce65fe5dd3484faf65f9c62b5abe88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46351 } } }
I20260929 06:42:07.111907 3762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:07.112200 3768 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:07.112721 3768 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 29 06:42:07 dist-test-slave-ltw5 krb5kdc[3675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 06:42:07.114526 3768 catalog_manager.cc:1347] Generated new cluster ID: eee6bb97495543d3aeb6b7a2dc846795
I20260929 06:42:07.114583 3768 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:07.118389 3760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:07.106865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50451 (local address 127.0.0.1:46351)
0929 06:42:07.107044 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:07.107054 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:07.107088 (+ 34us) server_negotiation.cc:407] Connection header received
0929 06:42:07.107688 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:07.107696 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:07.107756 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:07.107906 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:07.108508 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:07.109936 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:07.110862 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:07.111498 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:07.113486 (+ 1988us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:07.114585 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:07.114588 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:07.114589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:07.114601 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:07.116521 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:07.116932 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:07.116934 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:07.116935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:07.117025 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:07.117228 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:07.117228 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:07.117229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:07.117492 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:07.117642 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:07.118105 (+ 463us) server_negotiation.cc:299] Negotiation successful
0929 06:42:07.118201 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
I20260929 06:42:07.119686 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:07.128515 3760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:07.121184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40105 (local address 127.0.0.1:46351)
0929 06:42:07.121224 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:07.121226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:07.121356 (+ 130us) server_negotiation.cc:407] Connection header received
0929 06:42:07.121416 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:07.121417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:07.121427 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:07.121476 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:07.122168 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:07.122887 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:07.123903 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:07.124213 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:07.124270 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:07.125802 (+ 1532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:07.125803 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:07.125803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:07.125810 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:07.127319 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:07.127731 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:07.127732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:07.127732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:07.127787 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:07.128013 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:07.128013 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:07.128013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:07.128124 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:07.128216 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:07.128366 (+ 150us) server_negotiation.cc:299] Negotiation successful
0929 06:42:07.128423 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:42:07.133795 3768 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:07.134392 3768 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:07.148031 3768 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08ce65fe5dd3484faf65f9c62b5abe88: Generated new TSK 0
I20260929 06:42:07.148291 3768 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:07.154762 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 3688
W20260929 06:42:07.159382 3673 connection.cc:535] client connection to 127.0.0.1:46351 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46351): Connection reset by peer (error 104)
2026-09-29T06:42:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1328 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:07 dist-test-slave-ltw5 krb5kdc[3787](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:07 dist-test-slave-ltw5 krb5kdc[3787](info): set up 2 sockets
Sep 29 06:42:07 dist-test-slave-ltw5 krb5kdc[3787](info): commencing operation
krb5kdc: starting...
W20260929 06:42:08.186218 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:08 dist-test-slave-ltw5 krb5kdc[3787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:42:08.304389 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46251
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:08.386111 3800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:08.386593 3800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:08.386672 3800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:08.387857 3800 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:08.387924 3800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:08.387949 3800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:08.387970 3800 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:08.388000 3800 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:08.389528 3800 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46251
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:08.389806 3800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:08.390056 3800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:08.394858 3805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:08.394961 3806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:08.394979 3808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:08.395442 3800 server_base.cc:1034] running on GCE node
I20260929 06:42:08.395699 3800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:08.396004 3800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:08.397149 3800 hybrid_clock.cc:648] HybridClock initialized: now 1790664128397119 us; error 46 us; skew 500 ppm
Sep 29 06:42:08 dist-test-slave-ltw5 krb5kdc[3787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664128, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:08.399820 3800 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:42:08.400286 3800 webserver.cc:460] Webserver started at http://127.0.0.1:44103/ using document root <none> and password file <none>
I20260929 06:42:08.400509 3800 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:08.400554 3800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:08.400724 3800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:08.401796 3800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "43cfc93be71d462986687146b33ad0ef"
format_stamp: "Formatted at 2026-09-29 06:42:08 on dist-test-slave-ltw5"
server_key: "cce893be34d4d35621ddaa09e92ebbf0"
server_key_iv: "1e1d532aa23020164207198c1debe2c9"
server_key_version: "encryptionkey@0"
I20260929 06:42:08.402191 3800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "43cfc93be71d462986687146b33ad0ef"
format_stamp: "Formatted at 2026-09-29 06:42:08 on dist-test-slave-ltw5"
server_key: "cce893be34d4d35621ddaa09e92ebbf0"
server_key_iv: "1e1d532aa23020164207198c1debe2c9"
server_key_version: "encryptionkey@0"
I20260929 06:42:08.403517 3800 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:42:08.404271 3815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:08.404460 3800 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:42:08.404564 3800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "43cfc93be71d462986687146b33ad0ef"
format_stamp: "Formatted at 2026-09-29 06:42:08 on dist-test-slave-ltw5"
server_key: "cce893be34d4d35621ddaa09e92ebbf0"
server_key_iv: "1e1d532aa23020164207198c1debe2c9"
server_key_version: "encryptionkey@0"
I20260929 06:42:08.404637 3800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:08.414451 3800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:08.416356 3800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:08.416524 3800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:08.420594 3800 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46251
I20260929 06:42:08.420634 3867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46251 every 8 connection(s)
I20260929 06:42:08.421010 3800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:08.421835 3868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:08.424082 3868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef: Bootstrap starting.
I20260929 06:42:08.424650 3868 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:08.424932 3868 log.cc:824] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:08.425587 3868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef: No bootstrap required, opened a new log
I20260929 06:42:08.427160 3868 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43cfc93be71d462986687146b33ad0ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46251 } }
I20260929 06:42:08.427292 3868 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:08.427314 3868 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43cfc93be71d462986687146b33ad0ef, State: Initialized, Role: FOLLOWER
I20260929 06:42:08.427518 3868 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43cfc93be71d462986687146b33ad0ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46251 } }
I20260929 06:42:08.427600 3868 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:08.427641 3868 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:08.427690 3868 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:08.428193 3868 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43cfc93be71d462986687146b33ad0ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46251 } }
I20260929 06:42:08.428301 3868 leader_election.cc:302] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43cfc93be71d462986687146b33ad0ef; no voters:
I20260929 06:42:08.428480 3868 leader_election.cc:288] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:08.428529 3871 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:08.428717 3868 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:08.428702 3871 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [term 1 LEADER]: Becoming Leader. State: Replica: 43cfc93be71d462986687146b33ad0ef, State: Running, Role: LEADER
I20260929 06:42:08.429004 3871 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43cfc93be71d462986687146b33ad0ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46251 } }
I20260929 06:42:08.429453 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 3800
I20260929 06:42:08.429579 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:08.429569 3873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43cfc93be71d462986687146b33ad0ef. Latest consensus state: current_term: 1 leader_uuid: "43cfc93be71d462986687146b33ad0ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43cfc93be71d462986687146b33ad0ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46251 } } }
I20260929 06:42:08.429667 3873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:08.429800 15990 external_mini_cluster.cc:1428] Setting key e6c2b9941efef97c0bf78023c30491da
I20260929 06:42:08.429795 3872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43cfc93be71d462986687146b33ad0ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43cfc93be71d462986687146b33ad0ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46251 } } }
I20260929 06:42:08.429867 3872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef [sys.catalog]: This master's current role is: LEADER
W20260929 06:42:08.430791 3887 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:42:08.430857 3887 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:42:08.430914 3880 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:08.431082 3880 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:08.432467 3880 catalog_manager.cc:1347] Generated new cluster ID: 74457d06c2b949f1ae9b3ab5128da120
I20260929 06:42:08.432526 3880 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:08.437322 3889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:08.430268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36369 (local address 127.0.0.1:46251)
0929 06:42:08.430553 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:08.430560 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:08.430585 (+ 25us) server_negotiation.cc:407] Connection header received
0929 06:42:08.430703 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:08.430718 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:08.430777 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:08.431635 (+ 858us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:08.431739 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:08.434587 (+ 2848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:08.435381 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:08.435810 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:08.435934 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:08.436695 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:08.436699 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:08.436700 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:08.436872 (+ 172us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:08.436903 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:08.436913 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:08.437014 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:08.437097 (+ 83us) server_negotiation.cc:299] Negotiation successful
0929 06:42:08.437125 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":65,"threads_started":1}
I20260929 06:42:08.438282 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:08.442601 3889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:08.439621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41213 (local address 127.0.0.1:46251)
0929 06:42:08.439659 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:08.439661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:08.439779 (+ 118us) server_negotiation.cc:407] Connection header received
0929 06:42:08.439850 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:08.439851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:08.439861 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:08.439916 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:08.440038 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:08.440561 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:08.441324 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:08.441554 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:08.441647 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:08.442347 (+ 700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:08.442349 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:08.442349 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:08.442353 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:08.442367 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:08.442371 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:08.442424 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:08.442486 (+ 62us) server_negotiation.cc:299] Negotiation successful
0929 06:42:08.442498 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:42:08.467226 3880 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:08.467847 3880 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:08.479472 3880 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 43cfc93be71d462986687146b33ad0ef: Generated new TSK 0
I20260929 06:42:08.479769 3880 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:08.493314 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 3800
W20260929 06:42:08.499382 3785 connection.cc:535] client connection to 127.0.0.1:46251 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46251): Connection reset by peer (error 104)
2026-09-29T06:42:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1340 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:08 dist-test-slave-ltw5 krb5kdc[3899](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:08 dist-test-slave-ltw5 krb5kdc[3899](info): set up 2 sockets
Sep 29 06:42:08 dist-test-slave-ltw5 krb5kdc[3899](info): commencing operation
krb5kdc: starting...
W20260929 06:42:09.522174 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.009s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:09 dist-test-slave-ltw5 krb5kdc[3899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:42:09.637313 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36553
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:09.716647 3912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:09.716867 3912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:09.716905 3912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:09.718109 3912 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:09.718170 3912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:09.718196 3912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:09.718233 3912 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:09.718258 3912 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:09.719784 3912 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36553
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:09.720048 3912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:09.720275 3912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:09.725098 3918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:09.725191 3912 server_base.cc:1034] running on GCE node
W20260929 06:42:09.725132 3917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:09.725121 3920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:09.725489 3912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:09.725791 3912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:09.726953 3912 hybrid_clock.cc:648] HybridClock initialized: now 1790664129726937 us; error 42 us; skew 500 ppm
Sep 29 06:42:09 dist-test-slave-ltw5 krb5kdc[3899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664129, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:09.735092 3912 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:42:09.735484 3912 webserver.cc:460] Webserver started at http://127.0.0.1:37585/ using document root <none> and password file <none>
I20260929 06:42:09.735688 3912 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:09.735729 3912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:09.735843 3912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:09.736873 3912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "c74d468118b84df187a79921d8a8f3ac"
format_stamp: "Formatted at 2026-09-29 06:42:09 on dist-test-slave-ltw5"
server_key: "2cbfa7b84b5b7e0c012bd161ee750d09"
server_key_iv: "70d20fb35a870de134447423b23fd506"
server_key_version: "encryptionkey@0"
I20260929 06:42:09.737181 3912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "c74d468118b84df187a79921d8a8f3ac"
format_stamp: "Formatted at 2026-09-29 06:42:09 on dist-test-slave-ltw5"
server_key: "2cbfa7b84b5b7e0c012bd161ee750d09"
server_key_iv: "70d20fb35a870de134447423b23fd506"
server_key_version: "encryptionkey@0"
I20260929 06:42:09.738499 3912 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:42:09.739225 3927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:09.739419 3912 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:42:09.739506 3912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "c74d468118b84df187a79921d8a8f3ac"
format_stamp: "Formatted at 2026-09-29 06:42:09 on dist-test-slave-ltw5"
server_key: "2cbfa7b84b5b7e0c012bd161ee750d09"
server_key_iv: "70d20fb35a870de134447423b23fd506"
server_key_version: "encryptionkey@0"
I20260929 06:42:09.739589 3912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:09.742882 3912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:09.744619 3912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:09.744725 3912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:09.748530 3912 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36553
I20260929 06:42:09.748594 3979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36553 every 8 connection(s)
I20260929 06:42:09.748908 3912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:09.749765 3980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:09.751639 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 3912
I20260929 06:42:09.751756 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:09.751957 15990 external_mini_cluster.cc:1428] Setting key 06958d92617154262b01fb4bc45f2723
I20260929 06:42:09.752296 3980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac: Bootstrap starting.
I20260929 06:42:09.752914 3980 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:09.753207 3980 log.cc:824] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:09.753993 3980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac: No bootstrap required, opened a new log
I20260929 06:42:09.754456 3983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:09.752454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55359 (local address 127.0.0.1:36553)
0929 06:42:09.752625 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:09.752632 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:09.752656 (+ 24us) server_negotiation.cc:407] Connection header received
0929 06:42:09.753114 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:09.753121 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:09.753148 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:09.753265 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:09.753950 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:09.753955 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:09.753955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:09.753960 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:09.754003 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:09.754044 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:09.754147 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:09.754231 (+ 84us) server_negotiation.cc:299] Negotiation successful
0929 06:42:09.754271 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":70,"threads_started":1}
I20260929 06:42:09.755442 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:09.756587 3980 raft_consensus.cc:348] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c74d468118b84df187a79921d8a8f3ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36553 } }
I20260929 06:42:09.756773 3980 raft_consensus.cc:374] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:09.756820 3980 raft_consensus.cc:729] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74d468118b84df187a79921d8a8f3ac, State: Initialized, Role: FOLLOWER
I20260929 06:42:09.756940 3980 consensus_queue.cc:260] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c74d468118b84df187a79921d8a8f3ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36553 } }
I20260929 06:42:09.757035 3980 raft_consensus.cc:388] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:09.757077 3980 raft_consensus.cc:482] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:09.757123 3980 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:09.757885 3980 raft_consensus.cc:504] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c74d468118b84df187a79921d8a8f3ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36553 } }
I20260929 06:42:09.758004 3983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:09.757007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54421 (local address 127.0.0.1:36553)
0929 06:42:09.757050 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:09.757052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:09.757182 (+ 130us) server_negotiation.cc:407] Connection header received
0929 06:42:09.757269 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:09.757270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:09.757274 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:09.757319 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:09.757770 (+ 451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:09.757771 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:09.757771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:09.757774 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:09.757785 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:09.757788 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:09.757824 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:09.757888 (+ 64us) server_negotiation.cc:299] Negotiation successful
0929 06:42:09.757898 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 06:42:09.758050 3980 leader_election.cc:302] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c74d468118b84df187a79921d8a8f3ac; no voters:
I20260929 06:42:09.758213 3980 leader_election.cc:288] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:09.758234 3990 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:09.758339 3990 raft_consensus.cc:686] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [term 1 LEADER]: Becoming Leader. State: Replica: c74d468118b84df187a79921d8a8f3ac, State: Running, Role: LEADER
I20260929 06:42:09.758422 3990 consensus_queue.cc:237] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c74d468118b84df187a79921d8a8f3ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36553 } }
I20260929 06:42:09.758455 3980 sys_catalog.cc:564] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:09.758735 3990 sys_catalog.cc:455] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader c74d468118b84df187a79921d8a8f3ac. Latest consensus state: current_term: 1 leader_uuid: "c74d468118b84df187a79921d8a8f3ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c74d468118b84df187a79921d8a8f3ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36553 } } }
I20260929 06:42:09.758819 3990 sys_catalog.cc:458] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:09.758749 3991 sys_catalog.cc:455] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c74d468118b84df187a79921d8a8f3ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c74d468118b84df187a79921d8a8f3ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36553 } } }
I20260929 06:42:09.759004 3991 sys_catalog.cc:458] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:09.759393 3994 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:09.759883 3994 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:09.761339 3994 catalog_manager.cc:1347] Generated new cluster ID: a3e261f00171420da67a6218b5eff319
I20260929 06:42:09.761401 3994 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:09.766815 3994 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:09.766979 3994 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:09.773769 3994 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c74d468118b84df187a79921d8a8f3ac: Generated new TSK 0
I20260929 06:42:09.773948 3994 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:09.779879 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 3912
2026-09-29T06:42:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1284 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:09 dist-test-slave-ltw5 krb5kdc[4011](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:09 dist-test-slave-ltw5 krb5kdc[4011](info): set up 2 sockets
Sep 29 06:42:09 dist-test-slave-ltw5 krb5kdc[4011](info): commencing operation
krb5kdc: starting...
W20260929 06:42:10.806195 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.009s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:10 dist-test-slave-ltw5 krb5kdc[4011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:42:10.922328 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46245
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46245
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:11.003504 4024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:11.003733 4024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:11.003772 4024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:11.004923 4024 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:11.004992 4024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:11.005017 4024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:11.005048 4024 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:11.005071 4024 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:11.006577 4024 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46245
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:11.006855 4024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:11.007066 4024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:42:11.011790 4024 server_base.cc:1034] running on GCE node
W20260929 06:42:11.011807 4032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:11.011919 4029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:11.011804 4030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:11.012219 4024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:11.012451 4024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:11.013641 4024 hybrid_clock.cc:648] HybridClock initialized: now 1790664131013620 us; error 28 us; skew 500 ppm
Sep 29 06:42:11 dist-test-slave-ltw5 krb5kdc[4011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664131, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:11.016173 4024 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:42:11.016577 4024 webserver.cc:460] Webserver started at http://127.0.0.1:38521/ using document root <none> and password file <none>
I20260929 06:42:11.016793 4024 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:11.016861 4024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:11.017010 4024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:11.018075 4024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "f6cb87337e18448c899f269e3316da5b"
format_stamp: "Formatted at 2026-09-29 06:42:11 on dist-test-slave-ltw5"
server_key: "c86d29a0eb23c453e1c24bb337a87a70"
server_key_iv: "ad05b01e096f1d529c1d8c54d32aee9a"
server_key_version: "encryptionkey@0"
I20260929 06:42:11.018455 4024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "f6cb87337e18448c899f269e3316da5b"
format_stamp: "Formatted at 2026-09-29 06:42:11 on dist-test-slave-ltw5"
server_key: "c86d29a0eb23c453e1c24bb337a87a70"
server_key_iv: "ad05b01e096f1d529c1d8c54d32aee9a"
server_key_version: "encryptionkey@0"
I20260929 06:42:11.019744 4024 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:11.020449 4039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:11.020623 4024 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:42:11.020720 4024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "f6cb87337e18448c899f269e3316da5b"
format_stamp: "Formatted at 2026-09-29 06:42:11 on dist-test-slave-ltw5"
server_key: "c86d29a0eb23c453e1c24bb337a87a70"
server_key_iv: "ad05b01e096f1d529c1d8c54d32aee9a"
server_key_version: "encryptionkey@0"
I20260929 06:42:11.020807 4024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:11.036613 4024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:11.039047 4024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:11.039209 4024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:11.043035 4024 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46245
I20260929 06:42:11.043071 4091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46245 every 8 connection(s)
I20260929 06:42:11.043417 4024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:11.044287 4092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:11.046594 4092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b: Bootstrap starting.
I20260929 06:42:11.046836 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 4024
I20260929 06:42:11.046968 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:11.047169 15990 external_mini_cluster.cc:1428] Setting key e247038ac109ee79cbe861991d82505a
I20260929 06:42:11.047350 4092 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:11.047680 4092 log.cc:824] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:11.048396 4092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b: No bootstrap required, opened a new log
I20260929 06:42:11.050697 4092 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6cb87337e18448c899f269e3316da5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } }
I20260929 06:42:11.050861 4092 raft_consensus.cc:374] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:11.050904 4092 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6cb87337e18448c899f269e3316da5b, State: Initialized, Role: FOLLOWER
I20260929 06:42:11.051028 4092 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6cb87337e18448c899f269e3316da5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } }
I20260929 06:42:11.051083 4092 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:11.051105 4092 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:11.051131 4092 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:11.051597 4092 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6cb87337e18448c899f269e3316da5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } }
I20260929 06:42:11.051714 4092 leader_election.cc:302] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6cb87337e18448c899f269e3316da5b; no voters:
I20260929 06:42:11.051867 4092 leader_election.cc:288] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:11.051932 4097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:11.052073 4097 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [term 1 LEADER]: Becoming Leader. State: Replica: f6cb87337e18448c899f269e3316da5b, State: Running, Role: LEADER
I20260929 06:42:11.052089 4092 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:11.052160 4097 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6cb87337e18448c899f269e3316da5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } }
I20260929 06:42:11.052484 4097 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6cb87337e18448c899f269e3316da5b. Latest consensus state: current_term: 1 leader_uuid: "f6cb87337e18448c899f269e3316da5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6cb87337e18448c899f269e3316da5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } } }
I20260929 06:42:11.052561 4097 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:11.052771 4098 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6cb87337e18448c899f269e3316da5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6cb87337e18448c899f269e3316da5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } } }
I20260929 06:42:11.052882 4098 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:11.054466 4104 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Sep 29 06:42:11 dist-test-slave-ltw5 krb5kdc[4011](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 06:42:11.054946 4104 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:11.056519 4104 catalog_manager.cc:1347] Generated new cluster ID: 9239278e336f4cfca20f0ae9418cf437
I20260929 06:42:11.056568 4104 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:11.059064 4095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:11.047647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43219 (local address 127.0.0.1:46245)
0929 06:42:11.047904 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:11.047912 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:11.047950 (+ 38us) server_negotiation.cc:407] Connection header received
0929 06:42:11.048555 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:11.048564 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:11.048623 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:11.048780 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:11.049364 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:11.050839 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:11.051653 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:11.052282 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:11.052425 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:11.055310 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:11.055314 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:11.055315 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:11.055326 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:11.057343 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:11.057756 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:11.057759 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:11.057759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:11.057858 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:11.058120 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:11.058121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:11.058121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:11.058442 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:11.058601 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:11.058715 (+ 114us) server_negotiation.cc:299] Negotiation successful
0929 06:42:11.058854 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":86,"threads_started":1}
I20260929 06:42:11.059978 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:11.071491 4104 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:11.072139 4104 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:11.073093 4095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:11.061493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40055 (local address 127.0.0.1:46245)
0929 06:42:11.061539 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:11.061541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:11.066181 (+ 4640us) server_negotiation.cc:407] Connection header received
0929 06:42:11.066220 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:11.066221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:11.066243 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:11.066308 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:11.066882 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:11.067651 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:11.068588 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:11.068919 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:11.068990 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:11.070337 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:11.070338 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:11.070339 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:11.070346 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:11.071956 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:11.072330 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:11.072331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:11.072332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:11.072386 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:11.072607 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:11.072608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:11.072608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:11.072709 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:11.072803 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:11.072909 (+ 106us) server_negotiation.cc:299] Negotiation successful
0929 06:42:11.072990 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:42:11.079658 4104 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f6cb87337e18448c899f269e3316da5b: Generated new TSK 0
I20260929 06:42:11.079857 4104 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:11.081943 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 4024
2026-09-29T06:42:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1302 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:11 dist-test-slave-ltw5 krb5kdc[4123](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:11 dist-test-slave-ltw5 krb5kdc[4123](info): set up 2 sockets
Sep 29 06:42:11 dist-test-slave-ltw5 krb5kdc[4123](info): commencing operation
krb5kdc: starting...
W20260929 06:42:12.110319 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:12 dist-test-slave-ltw5 krb5kdc[4123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:42:12.229421 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38083
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:12.310544 4136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:12.310810 4136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:12.310854 4136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:12.312023 4136 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:12.312100 4136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:12.312125 4136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:12.312155 4136 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:12.312186 4136 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:12.313719 4136 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38083
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:12.314006 4136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:12.314266 4136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:12.319092 4141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:12.319092 4144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:12.319094 4142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:12.319193 4136 server_base.cc:1034] running on GCE node
I20260929 06:42:12.319651 4136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:12.319986 4136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:12.321167 4136 hybrid_clock.cc:648] HybridClock initialized: now 1790664132321153 us; error 27 us; skew 500 ppm
Sep 29 06:42:12 dist-test-slave-ltw5 krb5kdc[4123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664132, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:12.323709 4136 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:42:12.324203 4136 webserver.cc:460] Webserver started at http://127.0.0.1:44617/ using document root <none> and password file <none>
I20260929 06:42:12.324438 4136 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:12.324507 4136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:12.324707 4136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:12.325753 4136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "842f1a2e59f24c05becc02ca691a762f"
format_stamp: "Formatted at 2026-09-29 06:42:12 on dist-test-slave-ltw5"
server_key: "5eba5c8a62594192f0269856635914b8"
server_key_iv: "a454db962f268229780b0b39fd4e8f78"
server_key_version: "encryptionkey@0"
I20260929 06:42:12.326164 4136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "842f1a2e59f24c05becc02ca691a762f"
format_stamp: "Formatted at 2026-09-29 06:42:12 on dist-test-slave-ltw5"
server_key: "5eba5c8a62594192f0269856635914b8"
server_key_iv: "a454db962f268229780b0b39fd4e8f78"
server_key_version: "encryptionkey@0"
I20260929 06:42:12.327590 4136 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:42:12.328482 4151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:12.328750 4136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:42:12.328858 4136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "842f1a2e59f24c05becc02ca691a762f"
format_stamp: "Formatted at 2026-09-29 06:42:12 on dist-test-slave-ltw5"
server_key: "5eba5c8a62594192f0269856635914b8"
server_key_iv: "a454db962f268229780b0b39fd4e8f78"
server_key_version: "encryptionkey@0"
I20260929 06:42:12.328950 4136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:12.346140 4136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:12.348057 4136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:12.348224 4136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:12.352248 4136 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38083
I20260929 06:42:12.352286 4203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38083 every 8 connection(s)
I20260929 06:42:12.352646 4136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:12.353559 4204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:12.354123 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 4136
I20260929 06:42:12.354255 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:12.354439 15990 external_mini_cluster.cc:1428] Setting key 749076a048736bb8da0cb27c49733e92
I20260929 06:42:12.356463 4204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f: Bootstrap starting.
I20260929 06:42:12.357131 4204 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:12.357435 4204 log.cc:824] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:12.358203 4204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f: No bootstrap required, opened a new log
I20260929 06:42:12.360193 4207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:12.355004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47479 (local address 127.0.0.1:38083)
0929 06:42:12.355167 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:12.355174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:12.355199 (+ 25us) server_negotiation.cc:407] Connection header received
0929 06:42:12.355592 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:12.355600 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:12.355649 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:12.355768 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:12.356011 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:12.356949 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:12.358062 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:12.358525 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:12.358621 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:12.359476 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:12.359480 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:12.359480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:12.359659 (+ 179us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:12.359689 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:12.359701 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:12.359761 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:12.359865 (+ 104us) server_negotiation.cc:299] Negotiation successful
0929 06:42:12.359917 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":75,"threads_started":1}
I20260929 06:42:12.360611 4204 raft_consensus.cc:348] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "842f1a2e59f24c05becc02ca691a762f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38083 } }
I20260929 06:42:12.360802 4204 raft_consensus.cc:374] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:12.360884 4204 raft_consensus.cc:729] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842f1a2e59f24c05becc02ca691a762f, State: Initialized, Role: FOLLOWER
I20260929 06:42:12.361065 4204 consensus_queue.cc:260] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "842f1a2e59f24c05becc02ca691a762f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38083 } }
I20260929 06:42:12.361173 4204 raft_consensus.cc:388] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:12.361209 4204 raft_consensus.cc:482] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:12.361266 4204 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:12.361310 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:12.361850 4204 raft_consensus.cc:504] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "842f1a2e59f24c05becc02ca691a762f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38083 } }
I20260929 06:42:12.361971 4204 leader_election.cc:302] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 842f1a2e59f24c05becc02ca691a762f; no voters:
I20260929 06:42:12.362175 4204 leader_election.cc:288] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:12.362237 4209 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:12.362435 4209 raft_consensus.cc:686] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [term 1 LEADER]: Becoming Leader. State: Replica: 842f1a2e59f24c05becc02ca691a762f, State: Running, Role: LEADER
I20260929 06:42:12.362601 4209 consensus_queue.cc:237] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "842f1a2e59f24c05becc02ca691a762f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38083 } }
I20260929 06:42:12.362454 4204 sys_catalog.cc:564] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:12.363013 4211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "842f1a2e59f24c05becc02ca691a762f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "842f1a2e59f24c05becc02ca691a762f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38083 } } }
I20260929 06:42:12.363104 4211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:12.363029 4214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 842f1a2e59f24c05becc02ca691a762f. Latest consensus state: current_term: 1 leader_uuid: "842f1a2e59f24c05becc02ca691a762f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "842f1a2e59f24c05becc02ca691a762f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38083 } } }
I20260929 06:42:12.363159 4214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:12.363409 4218 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:12.363978 4218 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:12.365615 4218 catalog_manager.cc:1347] Generated new cluster ID: c6eed2d74067405793c4c5d39ec85d5e
I20260929 06:42:12.365670 4218 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:12.366631 4207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:12.362785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41043 (local address 127.0.0.1:38083)
0929 06:42:12.362819 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:12.362821 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:12.362979 (+ 158us) server_negotiation.cc:407] Connection header received
0929 06:42:12.363077 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:12.363078 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:12.363088 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:12.363118 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:12.363324 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:12.364062 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:12.365080 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:12.365316 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:12.365401 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:12.366267 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:12.366269 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:12.366269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:12.366274 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:12.366290 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:12.366296 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:12.366348 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:12.366523 (+ 175us) server_negotiation.cc:299] Negotiation successful
0929 06:42:12.366547 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:42:12.379766 4218 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:12.380486 4218 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:12.384994 4218 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 842f1a2e59f24c05becc02ca691a762f: Generated new TSK 0
I20260929 06:42:12.385212 4218 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:12.388015 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 4136
2026-09-29T06:42:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1305 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:12 dist-test-slave-ltw5 krb5kdc[4235](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:12 dist-test-slave-ltw5 krb5kdc[4235](info): set up 2 sockets
Sep 29 06:42:12 dist-test-slave-ltw5 krb5kdc[4235](info): commencing operation
krb5kdc: starting...
W20260929 06:42:13.422693 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:13 dist-test-slave-ltw5 krb5kdc[4235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:42:13.540266 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40599
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40599
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:13.622622 4248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:13.622828 4248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:13.622850 4248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:13.624027 4248 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:13.624069 4248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:13.624085 4248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:13.624097 4248 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:13.624109 4248 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:13.625655 4248 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:13.625901 4248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:13.626151 4248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:13.631059 4253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:13.631070 4254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:13.631182 4248 server_base.cc:1034] running on GCE node
W20260929 06:42:13.631146 4256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:13.631464 4248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:13.631778 4248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:13.632948 4248 hybrid_clock.cc:648] HybridClock initialized: now 1790664133632926 us; error 54 us; skew 500 ppm
Sep 29 06:42:13 dist-test-slave-ltw5 krb5kdc[4235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664133, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:13.635402 4248 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:42:13.635811 4248 webserver.cc:460] Webserver started at http://127.0.0.1:44385/ using document root <none> and password file <none>
I20260929 06:42:13.636062 4248 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:13.636130 4248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:13.636276 4248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:13.637319 4248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "6cf6a9bf521b466bb261da0518cdf384"
format_stamp: "Formatted at 2026-09-29 06:42:13 on dist-test-slave-ltw5"
server_key: "e24c6ce85a650082f38084d7af1d5c12"
server_key_iv: "e2d539930da4245d4134d2b0c84674bc"
server_key_version: "encryptionkey@0"
I20260929 06:42:13.637681 4248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "6cf6a9bf521b466bb261da0518cdf384"
format_stamp: "Formatted at 2026-09-29 06:42:13 on dist-test-slave-ltw5"
server_key: "e24c6ce85a650082f38084d7af1d5c12"
server_key_iv: "e2d539930da4245d4134d2b0c84674bc"
server_key_version: "encryptionkey@0"
I20260929 06:42:13.639092 4248 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:42:13.639894 4263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:13.640100 4248 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:42:13.640214 4248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "6cf6a9bf521b466bb261da0518cdf384"
format_stamp: "Formatted at 2026-09-29 06:42:13 on dist-test-slave-ltw5"
server_key: "e24c6ce85a650082f38084d7af1d5c12"
server_key_iv: "e2d539930da4245d4134d2b0c84674bc"
server_key_version: "encryptionkey@0"
I20260929 06:42:13.640297 4248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:13.643781 4248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:13.645709 4248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:13.645861 4248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:13.649590 4248 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40599
I20260929 06:42:13.649638 4315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40599 every 8 connection(s)
I20260929 06:42:13.649978 4248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:13.650913 4316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:13.653131 4316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384: Bootstrap starting.
I20260929 06:42:13.653743 4316 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:13.654076 4316 log.cc:824] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:13.654809 4316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384: No bootstrap required, opened a new log
I20260929 06:42:13.654983 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 4248
I20260929 06:42:13.655100 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:13.655295 15990 external_mini_cluster.cc:1428] Setting key c86646c2704f2aa8d9aaaefd85377638
I20260929 06:42:13.656836 4316 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cf6a9bf521b466bb261da0518cdf384" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40599 } }
I20260929 06:42:13.656996 4316 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:13.657033 4316 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf6a9bf521b466bb261da0518cdf384, State: Initialized, Role: FOLLOWER
I20260929 06:42:13.657205 4316 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cf6a9bf521b466bb261da0518cdf384" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40599 } }
I20260929 06:42:13.657305 4316 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:13.657353 4316 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:13.657401 4316 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:13.658156 4320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:13.655799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54275 (local address 127.0.0.1:40599)
0929 06:42:13.655966 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:13.655974 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:13.656015 (+ 41us) server_negotiation.cc:407] Connection header received
0929 06:42:13.656829 (+ 814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:13.656836 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:13.656866 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:13.656988 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:13.657663 (+ 675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:13.657666 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:13.657667 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:13.657670 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:13.657706 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:13.657716 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:13.657772 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:13.657864 (+ 92us) server_negotiation.cc:299] Negotiation successful
0929 06:42:13.657894 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":91,"threads_started":1}
I20260929 06:42:13.658586 4316 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cf6a9bf521b466bb261da0518cdf384" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40599 } }
I20260929 06:42:13.658721 4316 leader_election.cc:302] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cf6a9bf521b466bb261da0518cdf384; no voters:
I20260929 06:42:13.658880 4316 leader_election.cc:288] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:13.658906 4321 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:13.659066 4321 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf6a9bf521b466bb261da0518cdf384, State: Running, Role: LEADER
I20260929 06:42:13.659090 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:13.659134 4316 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:13.659192 4321 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cf6a9bf521b466bb261da0518cdf384" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40599 } }
I20260929 06:42:13.659512 4322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6cf6a9bf521b466bb261da0518cdf384" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cf6a9bf521b466bb261da0518cdf384" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40599 } } }
I20260929 06:42:13.659612 4322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:13.659768 4323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cf6a9bf521b466bb261da0518cdf384. Latest consensus state: current_term: 1 leader_uuid: "6cf6a9bf521b466bb261da0518cdf384" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cf6a9bf521b466bb261da0518cdf384" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40599 } } }
I20260929 06:42:13.659844 4323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:13.659940 4329 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:13.660413 4329 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:13.661821 4320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:13.660750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49271 (local address 127.0.0.1:40599)
0929 06:42:13.660803 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:13.660805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:13.660816 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:42:13.660889 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:13.660890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:13.660895 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:13.660948 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:13.661564 (+ 616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:13.661565 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:13.661566 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:13.661570 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:13.661584 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:13.661589 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:13.661646 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:13.661730 (+ 84us) server_negotiation.cc:299] Negotiation successful
0929 06:42:13.661746 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 06:42:13.666132 4329 catalog_manager.cc:1347] Generated new cluster ID: bde2c2b331b947749772bd204204074e
I20260929 06:42:13.666181 4329 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:13.676401 4329 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:13.676591 4329 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:13.682437 4329 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cf6a9bf521b466bb261da0518cdf384: Generated new TSK 0
I20260929 06:42:13.682623 4329 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:13.690735 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 4248
2026-09-29T06:42:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1303 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:13 dist-test-slave-ltw5 krb5kdc[4347](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:13 dist-test-slave-ltw5 krb5kdc[4347](info): set up 2 sockets
Sep 29 06:42:13 dist-test-slave-ltw5 krb5kdc[4347](info): commencing operation
krb5kdc: starting...
W20260929 06:42:14.734285 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:14 dist-test-slave-ltw5 krb5kdc[4347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:42:14.852626 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33207
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33207
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:14.932335 4360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:14.932536 4360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:14.932559 4360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:14.933769 4360 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:14.933813 4360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:14.933827 4360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:14.933840 4360 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:14.933884 4360 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:14.935380 4360 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:14.935631 4360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:14.935858 4360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:14.940629 4365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:14.940629 4368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:14.940863 4366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:14.940999 4360 server_base.cc:1034] running on GCE node
I20260929 06:42:14.941223 4360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:14.941460 4360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:14.942655 4360 hybrid_clock.cc:648] HybridClock initialized: now 1790664134942643 us; error 40 us; skew 500 ppm
Sep 29 06:42:14 dist-test-slave-ltw5 krb5kdc[4347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664134, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:14.950806 4360 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:42:14.951282 4360 webserver.cc:460] Webserver started at http://127.0.0.1:41999/ using document root <none> and password file <none>
I20260929 06:42:14.951536 4360 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:14.951635 4360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:14.951782 4360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:14.952869 4360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "eba7822561404702881e74e32f996d5c"
format_stamp: "Formatted at 2026-09-29 06:42:14 on dist-test-slave-ltw5"
server_key: "19d2141b5135e4dc2de32f7b7254117a"
server_key_iv: "e6f3db306e04d0b03812e9001ef5d5c6"
server_key_version: "encryptionkey@0"
I20260929 06:42:14.953238 4360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "eba7822561404702881e74e32f996d5c"
format_stamp: "Formatted at 2026-09-29 06:42:14 on dist-test-slave-ltw5"
server_key: "19d2141b5135e4dc2de32f7b7254117a"
server_key_iv: "e6f3db306e04d0b03812e9001ef5d5c6"
server_key_version: "encryptionkey@0"
I20260929 06:42:14.954727 4360 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:42:14.955518 4375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:14.955734 4360 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:14.955847 4360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "eba7822561404702881e74e32f996d5c"
format_stamp: "Formatted at 2026-09-29 06:42:14 on dist-test-slave-ltw5"
server_key: "19d2141b5135e4dc2de32f7b7254117a"
server_key_iv: "e6f3db306e04d0b03812e9001ef5d5c6"
server_key_version: "encryptionkey@0"
I20260929 06:42:14.955925 4360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:14.968047 4360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:14.970155 4360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:14.970319 4360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:14.974318 4360 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33207
I20260929 06:42:14.974352 4427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33207 every 8 connection(s)
I20260929 06:42:14.974756 4360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:14.975659 4428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:14.977485 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 4360
I20260929 06:42:14.977604 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:14.977782 15990 external_mini_cluster.cc:1428] Setting key 33f83e317b1fcef607c90551587e3b50
I20260929 06:42:14.978322 4428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c: Bootstrap starting.
I20260929 06:42:14.978945 4428 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:14.979269 4428 log.cc:824] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:14.980021 4428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c: No bootstrap required, opened a new log
I20260929 06:42:14.982179 4428 raft_consensus.cc:348] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba7822561404702881e74e32f996d5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33207 } }
I20260929 06:42:14.982312 4428 raft_consensus.cc:374] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:14.982334 4428 raft_consensus.cc:729] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eba7822561404702881e74e32f996d5c, State: Initialized, Role: FOLLOWER
I20260929 06:42:14.982484 4428 consensus_queue.cc:260] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba7822561404702881e74e32f996d5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33207 } }
I20260929 06:42:14.982543 4428 raft_consensus.cc:388] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:14.982565 4428 raft_consensus.cc:482] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:14.982640 4428 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:14.983209 4428 raft_consensus.cc:504] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba7822561404702881e74e32f996d5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33207 } }
I20260929 06:42:14.983317 4428 leader_election.cc:302] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eba7822561404702881e74e32f996d5c; no voters:
I20260929 06:42:14.983491 4428 leader_election.cc:288] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:14.983511 4433 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:14.983623 4433 raft_consensus.cc:686] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [term 1 LEADER]: Becoming Leader. State: Replica: eba7822561404702881e74e32f996d5c, State: Running, Role: LEADER
I20260929 06:42:14.983765 4433 consensus_queue.cc:237] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba7822561404702881e74e32f996d5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33207 } }
I20260929 06:42:14.983764 4428 sys_catalog.cc:564] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [sys.catalog]: configured and running, proceeding with master startup.
Sep 29 06:42:14 dist-test-slave-ltw5 krb5kdc[4347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 06:42:14.985599 4434 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eba7822561404702881e74e32f996d5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba7822561404702881e74e32f996d5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33207 } } }
I20260929 06:42:14.985690 4434 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [sys.catalog]: This master's current role is: LEADER
W20260929 06:42:14.985724 4448 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:42:14.985765 4448 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:42:14.985895 4435 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader eba7822561404702881e74e32f996d5c. Latest consensus state: current_term: 1 leader_uuid: "eba7822561404702881e74e32f996d5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba7822561404702881e74e32f996d5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33207 } } }
I20260929 06:42:14.985983 4435 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:14.986146 4450 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:14.986336 4450 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:14.987972 4450 catalog_manager.cc:1347] Generated new cluster ID: d5e8d705ec1d443eb59e9cc3d108bd3f
I20260929 06:42:14.988025 4450 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:14.989595 4431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:14.978334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:58403 (local address 127.0.0.1:33207)
0929 06:42:14.978510 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:14.978519 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:14.978543 (+ 24us) server_negotiation.cc:407] Connection header received
0929 06:42:14.978972 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:14.979008 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:14.979074 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:14.979207 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:14.979957 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:14.980885 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:14.982068 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:14.982656 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:14.982768 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:14.985811 (+ 3043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:14.985815 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:14.985815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:14.985827 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:14.987895 (+ 2068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:14.988328 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:14.988332 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:14.988332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:14.988435 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:14.988702 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:14.988703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:14.988703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:14.988980 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:14.989136 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:14.989284 (+ 148us) server_negotiation.cc:299] Negotiation successful
0929 06:42:14.989378 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":69,"threads_started":1}
I20260929 06:42:14.990543 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:14.998979 4431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:14.991926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:51595 (local address 127.0.0.1:33207)
0929 06:42:14.991961 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:14.991962 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:14.991996 (+ 34us) server_negotiation.cc:407] Connection header received
0929 06:42:14.992051 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:14.992052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:14.992064 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:14.992133 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:14.992698 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:14.993455 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:14.994449 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:14.994770 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:14.994852 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:14.996173 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:14.996174 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:14.996174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:14.996181 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:14.997771 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:14.998187 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:14.998188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:14.998188 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:14.998249 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:14.998473 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:14.998473 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:14.998474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:14.998600 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:14.998712 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:14.998820 (+ 108us) server_negotiation.cc:299] Negotiation successful
0929 06:42:14.998884 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:42:15.009164 4450 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:15.009881 4450 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:15.017047 4450 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eba7822561404702881e74e32f996d5c: Generated new TSK 0
I20260929 06:42:15.017313 4450 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:15.023692 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 4360
W20260929 06:42:15.028038 4345 connection.cc:535] client connection to 127.0.0.1:33207 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33207): Connection reset by peer (error 104)
2026-09-29T06:42:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1332 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:15 dist-test-slave-ltw5 krb5kdc[4459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:15 dist-test-slave-ltw5 krb5kdc[4459](info): set up 2 sockets
Sep 29 06:42:15 dist-test-slave-ltw5 krb5kdc[4459](info): commencing operation
krb5kdc: starting...
W20260929 06:42:16.062222 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:16 dist-test-slave-ltw5 krb5kdc[4459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:42:16.180675 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33383
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33383
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:16.259685 4472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:16.259886 4472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:16.259909 4472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:16.260970 4472 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:16.261005 4472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:16.261020 4472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:16.261032 4472 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:16.261044 4472 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:16.262526 4472 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:16.262718 4472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:16.262878 4472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:16.267699 4480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:16.267680 4478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:16.267670 4477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:16.267843 4472 server_base.cc:1034] running on GCE node
I20260929 06:42:16.268148 4472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:16.268427 4472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:16.269585 4472 hybrid_clock.cc:648] HybridClock initialized: now 1790664136269580 us; error 36 us; skew 500 ppm
Sep 29 06:42:16 dist-test-slave-ltw5 krb5kdc[4459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664136, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:16.272044 4472 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:42:16.272425 4472 webserver.cc:460] Webserver started at http://127.0.0.1:39245/ using document root <none> and password file <none>
I20260929 06:42:16.272667 4472 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:16.272713 4472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:16.272881 4472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:16.273940 4472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "97a5e6659b5f4e9a91c45db044d53e39"
format_stamp: "Formatted at 2026-09-29 06:42:16 on dist-test-slave-ltw5"
server_key: "20e5fdfd046de9ac5c0346b2657e2f05"
server_key_iv: "c6da6d86d92c7ac7dc30bea3950a51d7"
server_key_version: "encryptionkey@0"
I20260929 06:42:16.274375 4472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "97a5e6659b5f4e9a91c45db044d53e39"
format_stamp: "Formatted at 2026-09-29 06:42:16 on dist-test-slave-ltw5"
server_key: "20e5fdfd046de9ac5c0346b2657e2f05"
server_key_iv: "c6da6d86d92c7ac7dc30bea3950a51d7"
server_key_version: "encryptionkey@0"
I20260929 06:42:16.275681 4472 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:16.276405 4487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:16.276625 4472 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:16.276712 4472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "97a5e6659b5f4e9a91c45db044d53e39"
format_stamp: "Formatted at 2026-09-29 06:42:16 on dist-test-slave-ltw5"
server_key: "20e5fdfd046de9ac5c0346b2657e2f05"
server_key_iv: "c6da6d86d92c7ac7dc30bea3950a51d7"
server_key_version: "encryptionkey@0"
I20260929 06:42:16.276765 4472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:16.305178 4472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:16.307193 4472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:16.307305 4472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:16.311355 4472 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33383
I20260929 06:42:16.311436 4539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33383 every 8 connection(s)
I20260929 06:42:16.311767 4472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:16.312636 4540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:16.314849 4540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39: Bootstrap starting.
I20260929 06:42:16.315286 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 4472
I20260929 06:42:16.315411 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:16.315574 4540 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:16.315616 15990 external_mini_cluster.cc:1428] Setting key 0acfd7d72e47c38676296c984f54052f
I20260929 06:42:16.315877 4540 log.cc:824] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:16.316676 4540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39: No bootstrap required, opened a new log
I20260929 06:42:16.318818 4540 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97a5e6659b5f4e9a91c45db044d53e39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33383 } }
I20260929 06:42:16.318979 4540 raft_consensus.cc:374] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:16.319010 4540 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97a5e6659b5f4e9a91c45db044d53e39, State: Initialized, Role: FOLLOWER
I20260929 06:42:16.319119 4540 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97a5e6659b5f4e9a91c45db044d53e39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33383 } }
I20260929 06:42:16.319187 4540 raft_consensus.cc:388] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:16.319216 4540 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:16.319271 4540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:16.319947 4540 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97a5e6659b5f4e9a91c45db044d53e39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33383 } }
I20260929 06:42:16.320060 4540 leader_election.cc:302] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97a5e6659b5f4e9a91c45db044d53e39; no voters:
I20260929 06:42:16.320209 4540 leader_election.cc:288] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:16.320223 4545 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:16.320485 4540 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:16.320703 4545 raft_consensus.cc:686] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [term 1 LEADER]: Becoming Leader. State: Replica: 97a5e6659b5f4e9a91c45db044d53e39, State: Running, Role: LEADER
I20260929 06:42:16.320796 4545 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97a5e6659b5f4e9a91c45db044d53e39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33383 } }
I20260929 06:42:16.321125 4545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97a5e6659b5f4e9a91c45db044d53e39. Latest consensus state: current_term: 1 leader_uuid: "97a5e6659b5f4e9a91c45db044d53e39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97a5e6659b5f4e9a91c45db044d53e39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33383 } } }
I20260929 06:42:16.321272 4545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:16.321641 4544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:16.316114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:44191 (local address 127.0.0.1:33383)
0929 06:42:16.316288 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:16.316298 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:16.316334 (+ 36us) server_negotiation.cc:407] Connection header received
0929 06:42:16.316855 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:16.316863 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:16.316912 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:16.317026 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:16.317277 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:16.318194 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:16.319313 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:16.319917 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:16.320052 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:16.320763 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:16.320768 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:16.320769 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:16.320988 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:16.321030 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:16.321045 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:16.321130 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:16.321396 (+ 266us) server_negotiation.cc:299] Negotiation successful
0929 06:42:16.321425 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
I20260929 06:42:16.321514 4554 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:16.322088 4546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "97a5e6659b5f4e9a91c45db044d53e39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97a5e6659b5f4e9a91c45db044d53e39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33383 } } }
I20260929 06:42:16.322290 4546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:16.322548 4554 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:16.322754 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:16.324280 4554 catalog_manager.cc:1347] Generated new cluster ID: 048093afb88f445cbd43b574d73aceae
I20260929 06:42:16.324329 4554 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:16.327275 4544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:16.324379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:50317 (local address 127.0.0.1:33383)
0929 06:42:16.324418 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:16.324420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:16.324490 (+ 70us) server_negotiation.cc:407] Connection header received
0929 06:42:16.324562 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:16.324563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:16.324573 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:16.324626 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:16.324791 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:16.325262 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:16.325982 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:16.326268 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:16.326344 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:16.327010 (+ 666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:16.327011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:16.327011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:16.327016 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:16.327030 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:16.327034 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:16.327091 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:16.327171 (+ 80us) server_negotiation.cc:299] Negotiation successful
0929 06:42:16.327180 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:42:16.336429 4554 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:16.336974 4554 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:16.342109 4554 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 97a5e6659b5f4e9a91c45db044d53e39: Generated new TSK 0
I20260929 06:42:16.342295 4554 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:16.345146 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 4472
W20260929 06:42:16.349395 4457 connection.cc:535] client connection to 127.0.0.1:33383 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33383): Connection reset by peer (error 104)
2026-09-29T06:42:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1323 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:16 dist-test-slave-ltw5 krb5kdc[4571](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:16 dist-test-slave-ltw5 krb5kdc[4571](info): set up 2 sockets
Sep 29 06:42:16 dist-test-slave-ltw5 krb5kdc[4571](info): commencing operation
krb5kdc: starting...
W20260929 06:42:17.366214 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.001s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:17 dist-test-slave-ltw5 krb5kdc[4571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664137, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:42:17.484586 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34887
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34887
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:17.563697 4584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:17.563949 4584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:17.563987 4584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:17.565214 4584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:17.565292 4584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:17.565316 4584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:17.565337 4584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:17.565367 4584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:17.566910 4584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34887
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:17.567201 4584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:17.567435 4584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:17.572289 4592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:17.572289 4590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:17.572326 4589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:17.572453 4584 server_base.cc:1034] running on GCE node
I20260929 06:42:17.572811 4584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:17.573112 4584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:17.574285 4584 hybrid_clock.cc:648] HybridClock initialized: now 1790664137574264 us; error 29 us; skew 500 ppm
Sep 29 06:42:17 dist-test-slave-ltw5 krb5kdc[4571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664137, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:17.576808 4584 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:42:17.577279 4584 webserver.cc:460] Webserver started at http://127.0.0.1:38967/ using document root <none> and password file <none>
I20260929 06:42:17.577517 4584 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:17.577564 4584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:17.577687 4584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:17.578851 4584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "cb5d2279c9fc449e838db1cd545bb052"
format_stamp: "Formatted at 2026-09-29 06:42:17 on dist-test-slave-ltw5"
server_key: "8c4024a6d49999728a492b2ec50bab8d"
server_key_iv: "958b4a05e2f1ab345a43fb595d8c92dc"
server_key_version: "encryptionkey@0"
I20260929 06:42:17.579228 4584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "cb5d2279c9fc449e838db1cd545bb052"
format_stamp: "Formatted at 2026-09-29 06:42:17 on dist-test-slave-ltw5"
server_key: "8c4024a6d49999728a492b2ec50bab8d"
server_key_iv: "958b4a05e2f1ab345a43fb595d8c92dc"
server_key_version: "encryptionkey@0"
I20260929 06:42:17.580598 4584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:42:17.581338 4599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:17.581535 4584 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:42:17.581625 4584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "cb5d2279c9fc449e838db1cd545bb052"
format_stamp: "Formatted at 2026-09-29 06:42:17 on dist-test-slave-ltw5"
server_key: "8c4024a6d49999728a492b2ec50bab8d"
server_key_iv: "958b4a05e2f1ab345a43fb595d8c92dc"
server_key_version: "encryptionkey@0"
I20260929 06:42:17.581682 4584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:17.584892 4584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:17.586907 4584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:17.587009 4584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:17.590723 4584 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34887
I20260929 06:42:17.590791 4651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34887 every 8 connection(s)
I20260929 06:42:17.591131 4584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:17.592000 4652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:17.594336 4652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052: Bootstrap starting.
I20260929 06:42:17.594892 4652 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:17.595181 4652 log.cc:824] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:17.595844 4652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052: No bootstrap required, opened a new log
I20260929 06:42:17.597397 4652 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb5d2279c9fc449e838db1cd545bb052" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34887 } }
I20260929 06:42:17.597563 4652 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:17.597587 4652 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb5d2279c9fc449e838db1cd545bb052, State: Initialized, Role: FOLLOWER
I20260929 06:42:17.597775 4652 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb5d2279c9fc449e838db1cd545bb052" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34887 } }
I20260929 06:42:17.597855 4652 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:17.597898 4652 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:17.597949 4652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:17.598472 4652 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb5d2279c9fc449e838db1cd545bb052" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34887 } }
I20260929 06:42:17.598588 4652 leader_election.cc:302] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb5d2279c9fc449e838db1cd545bb052; no voters:
I20260929 06:42:17.598785 4652 leader_election.cc:288] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:17.598814 4655 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:17.598851 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 4584
I20260929 06:42:17.598927 4655 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [term 1 LEADER]: Becoming Leader. State: Replica: cb5d2279c9fc449e838db1cd545bb052, State: Running, Role: LEADER
I20260929 06:42:17.598975 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:17.599005 4655 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb5d2279c9fc449e838db1cd545bb052" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34887 } }
I20260929 06:42:17.599036 4652 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:17.599144 15990 external_mini_cluster.cc:1428] Setting key a66a0e8cfeb3b358a0630104ef2181a7
I20260929 06:42:17.599295 4655 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb5d2279c9fc449e838db1cd545bb052. Latest consensus state: current_term: 1 leader_uuid: "cb5d2279c9fc449e838db1cd545bb052" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb5d2279c9fc449e838db1cd545bb052" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34887 } } }
I20260929 06:42:17.599354 4655 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:17.599457 4656 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb5d2279c9fc449e838db1cd545bb052" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb5d2279c9fc449e838db1cd545bb052" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34887 } } }
I20260929 06:42:17.599539 4656 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:17.599568 4659 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:17.600292 4659 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:17.602113 4659 catalog_manager.cc:1347] Generated new cluster ID: 24d21b67cc3c487db87775cba3c159ee
I20260929 06:42:17.602177 4659 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:17.602322 4666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:17.599764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:33159 (local address 127.0.0.1:34887)
0929 06:42:17.599928 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:17.599937 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:17.600116 (+ 179us) server_negotiation.cc:407] Connection header received
0929 06:42:17.600367 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:17.600374 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:17.600408 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:17.600600 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:17.601665 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:17.601669 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:17.601669 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:17.601674 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:17.601728 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:17.601742 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:17.601819 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:17.601987 (+ 168us) server_negotiation.cc:299] Negotiation successful
0929 06:42:17.602058 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
I20260929 06:42:17.603348 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:17.605778 4666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:17.604687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:52933 (local address 127.0.0.1:34887)
0929 06:42:17.604729 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:17.604731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:17.604844 (+ 113us) server_negotiation.cc:407] Connection header received
0929 06:42:17.604915 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:17.604916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:17.604921 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:17.604975 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:17.605575 (+ 600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:17.605577 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:17.605577 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:17.605581 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:17.605596 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:17.605600 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:17.605645 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:17.605705 (+ 60us) server_negotiation.cc:299] Negotiation successful
0929 06:42:17.605717 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:42:17.624416 4659 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:17.624626 4659 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:17.631876 4659 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb5d2279c9fc449e838db1cd545bb052: Generated new TSK 0
I20260929 06:42:17.632091 4659 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:17.640487 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 4584
2026-09-29T06:42:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1293 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:17 dist-test-slave-ltw5 krb5kdc[4683](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:17 dist-test-slave-ltw5 krb5kdc[4683](info): set up 2 sockets
Sep 29 06:42:17 dist-test-slave-ltw5 krb5kdc[4683](info): commencing operation
krb5kdc: starting...
W20260929 06:42:18.670213 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:18 dist-test-slave-ltw5 krb5kdc[4683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:42:18.787222 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46211
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46211
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:18.867100 4696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:18.867311 4696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:18.867334 4696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:18.868528 4696 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:18.868592 4696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:18.868605 4696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:18.868618 4696 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:18.868631 4696 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:18.870180 4696 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46211
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:18.870450 4696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:18.870692 4696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:18.875785 4704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:18.875767 4701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:18.875865 4702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:18.875939 4696 server_base.cc:1034] running on GCE node
I20260929 06:42:18.876351 4696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:18.876663 4696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:18.877826 4696 hybrid_clock.cc:648] HybridClock initialized: now 1790664138877805 us; error 46 us; skew 500 ppm
Sep 29 06:42:18 dist-test-slave-ltw5 krb5kdc[4683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664138, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:18.880959 4696 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:42:18.881482 4696 webserver.cc:460] Webserver started at http://127.0.0.1:45869/ using document root <none> and password file <none>
I20260929 06:42:18.881683 4696 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:18.881727 4696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:18.881824 4696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:18.882983 4696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "98f3915bf1dc49a7b62c4b9374d61b75"
format_stamp: "Formatted at 2026-09-29 06:42:18 on dist-test-slave-ltw5"
server_key: "2c00be9cbf2f5de19eee523a469530a9"
server_key_iv: "6df3c431c6176a72f21446edec7acf41"
server_key_version: "encryptionkey@0"
I20260929 06:42:18.883309 4696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "98f3915bf1dc49a7b62c4b9374d61b75"
format_stamp: "Formatted at 2026-09-29 06:42:18 on dist-test-slave-ltw5"
server_key: "2c00be9cbf2f5de19eee523a469530a9"
server_key_iv: "6df3c431c6176a72f21446edec7acf41"
server_key_version: "encryptionkey@0"
I20260929 06:42:18.884685 4696 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:42:18.885413 4711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:18.885617 4696 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:18.885704 4696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "98f3915bf1dc49a7b62c4b9374d61b75"
format_stamp: "Formatted at 2026-09-29 06:42:18 on dist-test-slave-ltw5"
server_key: "2c00be9cbf2f5de19eee523a469530a9"
server_key_iv: "6df3c431c6176a72f21446edec7acf41"
server_key_version: "encryptionkey@0"
I20260929 06:42:18.885759 4696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:18.908073 4696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:18.910288 4696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:18.910415 4696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:18.914577 4696 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46211
I20260929 06:42:18.914656 4763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46211 every 8 connection(s)
I20260929 06:42:18.915031 4696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:18.915940 4764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:18.918241 4764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75: Bootstrap starting.
I20260929 06:42:18.918833 4764 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:18.919117 4764 log.cc:824] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:18.919807 4764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75: No bootstrap required, opened a new log
I20260929 06:42:18.921361 4764 raft_consensus.cc:348] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98f3915bf1dc49a7b62c4b9374d61b75" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46211 } }
I20260929 06:42:18.921496 4764 raft_consensus.cc:374] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:18.921518 4764 raft_consensus.cc:729] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98f3915bf1dc49a7b62c4b9374d61b75, State: Initialized, Role: FOLLOWER
I20260929 06:42:18.921698 4764 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98f3915bf1dc49a7b62c4b9374d61b75" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46211 } }
I20260929 06:42:18.921785 4764 raft_consensus.cc:388] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:18.921823 4764 raft_consensus.cc:482] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:18.921850 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 4696
I20260929 06:42:18.921892 4764 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:18.921963 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:18.922163 15990 external_mini_cluster.cc:1428] Setting key 062a94b6950577cbb4c478106cbf1a83
I20260929 06:42:18.922683 4764 raft_consensus.cc:504] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98f3915bf1dc49a7b62c4b9374d61b75" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46211 } }
I20260929 06:42:18.922793 4764 leader_election.cc:302] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98f3915bf1dc49a7b62c4b9374d61b75; no voters:
I20260929 06:42:18.922950 4764 leader_election.cc:288] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:18.922986 4769 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:18.923149 4769 raft_consensus.cc:686] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [term 1 LEADER]: Becoming Leader. State: Replica: 98f3915bf1dc49a7b62c4b9374d61b75, State: Running, Role: LEADER
I20260929 06:42:18.923183 4764 sys_catalog.cc:564] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:18.923301 4769 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98f3915bf1dc49a7b62c4b9374d61b75" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46211 } }
I20260929 06:42:18.923619 4769 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98f3915bf1dc49a7b62c4b9374d61b75. Latest consensus state: current_term: 1 leader_uuid: "98f3915bf1dc49a7b62c4b9374d61b75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98f3915bf1dc49a7b62c4b9374d61b75" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46211 } } }
I20260929 06:42:18.923966 4769 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:18.923897 4770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98f3915bf1dc49a7b62c4b9374d61b75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98f3915bf1dc49a7b62c4b9374d61b75" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46211 } } }
I20260929 06:42:18.924356 4770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:18.924474 4778 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:18.925046 4778 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:18.926594 4778 catalog_manager.cc:1347] Generated new cluster ID: 3af9eff6e96244898c240a8c90331541
I20260929 06:42:18.926656 4778 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:42:18 dist-test-slave-ltw5 krb5kdc[4683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 06:42:18.933460 4768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:18.922683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:47463 (local address 127.0.0.1:46211)
0929 06:42:18.922876 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:18.922888 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:18.922924 (+ 36us) server_negotiation.cc:407] Connection header received
0929 06:42:18.923047 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:18.923056 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:18.923115 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:18.924109 (+ 994us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:18.924252 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:18.925462 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:18.926434 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:18.927027 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:18.927140 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:18.929892 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:18.929896 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:18.929896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:18.929907 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:18.931787 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:18.932237 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:18.932239 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:18.932240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:18.932349 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:18.932591 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:18.932591 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:18.932591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:18.932876 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:18.933018 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:18.933167 (+ 149us) server_negotiation.cc:299] Negotiation successful
0929 06:42:18.933259 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":78,"threads_started":1}
I20260929 06:42:18.934448 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:18.936882 4778 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:18.937557 4778 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:18.942493 4778 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 98f3915bf1dc49a7b62c4b9374d61b75: Generated new TSK 0
I20260929 06:42:18.942682 4778 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:18.942869 4768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:18.936758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:54857 (local address 127.0.0.1:46211)
0929 06:42:18.936796 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:18.936798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:18.936921 (+ 123us) server_negotiation.cc:407] Connection header received
0929 06:42:18.936990 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:18.936991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:18.937001 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:18.937077 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:18.937566 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:18.938065 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:18.938764 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:18.938962 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:18.939044 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:18.940168 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:18.940169 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:18.940170 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:18.940176 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:18.941495 (+ 1319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:18.941852 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:18.941853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:18.941854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:18.941910 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:18.942163 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:18.942164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:18.942164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:18.942283 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:18.942376 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:18.942658 (+ 282us) server_negotiation.cc:299] Negotiation successful
0929 06:42:18.942806 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:42:18.944617 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 4696
W20260929 06:42:18.948925 4681 connection.cc:535] client connection to 127.0.0.1:46211 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46211): Connection reset by peer (error 104)
2026-09-29T06:42:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1303 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:18 dist-test-slave-ltw5 krb5kdc[4795](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:19 dist-test-slave-ltw5 krb5kdc[4795](info): set up 2 sockets
Sep 29 06:42:19 dist-test-slave-ltw5 krb5kdc[4795](info): commencing operation
krb5kdc: starting...
W20260929 06:42:19.998150 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:20 dist-test-slave-ltw5 krb5kdc[4795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664140, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:42:20.118366 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45837
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:20.200273 4808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:20.200493 4808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:20.200518 4808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:20.201687 4808 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:20.201730 4808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:20.201745 4808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:20.201758 4808 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:20.201771 4808 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:20.203430 4808 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45837
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:20.203656 4808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:20.203835 4808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:20.208776 4816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:20.208771 4814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:20.208812 4808 server_base.cc:1034] running on GCE node
W20260929 06:42:20.208770 4813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:20.209398 4808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:20.209717 4808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:20.210857 4808 hybrid_clock.cc:648] HybridClock initialized: now 1790664140210848 us; error 31 us; skew 500 ppm
Sep 29 06:42:20 dist-test-slave-ltw5 krb5kdc[4795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664140, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:20.219656 4808 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:42:20.220227 4808 webserver.cc:460] Webserver started at http://127.0.0.1:37959/ using document root <none> and password file <none>
I20260929 06:42:20.220468 4808 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:20.220548 4808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:20.220700 4808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:20.221856 4808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "f7366be44cfc4ea2931450c3fb4c4a8a"
format_stamp: "Formatted at 2026-09-29 06:42:20 on dist-test-slave-ltw5"
server_key: "89acaedf0c2903461fa5691bafa33266"
server_key_iv: "69c47eb843d2a7652f95f804adac89db"
server_key_version: "encryptionkey@0"
I20260929 06:42:20.222263 4808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "f7366be44cfc4ea2931450c3fb4c4a8a"
format_stamp: "Formatted at 2026-09-29 06:42:20 on dist-test-slave-ltw5"
server_key: "89acaedf0c2903461fa5691bafa33266"
server_key_iv: "69c47eb843d2a7652f95f804adac89db"
server_key_version: "encryptionkey@0"
I20260929 06:42:20.223798 4808 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:42:20.224611 4823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:20.224807 4808 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:20.224916 4808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "f7366be44cfc4ea2931450c3fb4c4a8a"
format_stamp: "Formatted at 2026-09-29 06:42:20 on dist-test-slave-ltw5"
server_key: "89acaedf0c2903461fa5691bafa33266"
server_key_iv: "69c47eb843d2a7652f95f804adac89db"
server_key_version: "encryptionkey@0"
I20260929 06:42:20.224993 4808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:20.238720 4808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:20.240772 4808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:20.240947 4808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:20.245070 4808 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45837
I20260929 06:42:20.245106 4875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45837 every 8 connection(s)
I20260929 06:42:20.245501 4808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:20.246420 4876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:20.248701 4876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a: Bootstrap starting.
I20260929 06:42:20.249282 4876 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:20.249568 4876 log.cc:824] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:20.250589 4876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a: No bootstrap required, opened a new log
I20260929 06:42:20.252241 4876 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7366be44cfc4ea2931450c3fb4c4a8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45837 } }
I20260929 06:42:20.252382 4876 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:20.252405 4876 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7366be44cfc4ea2931450c3fb4c4a8a, State: Initialized, Role: FOLLOWER
I20260929 06:42:20.252578 4876 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7366be44cfc4ea2931450c3fb4c4a8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45837 } }
I20260929 06:42:20.252640 4876 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:20.252698 4876 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:20.252753 4876 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:20.253145 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 4808
I20260929 06:42:20.253242 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:20.253381 4876 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7366be44cfc4ea2931450c3fb4c4a8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45837 } }
I20260929 06:42:20.253466 15990 external_mini_cluster.cc:1428] Setting key a38684f52603296c358f43318589184c
I20260929 06:42:20.253509 4876 leader_election.cc:302] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7366be44cfc4ea2931450c3fb4c4a8a; no voters:
I20260929 06:42:20.253688 4876 leader_election.cc:288] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:20.253720 4879 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:20.253908 4879 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [term 1 LEADER]: Becoming Leader. State: Replica: f7366be44cfc4ea2931450c3fb4c4a8a, State: Running, Role: LEADER
I20260929 06:42:20.253952 4876 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:20.254055 4879 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7366be44cfc4ea2931450c3fb4c4a8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45837 } }
I20260929 06:42:20.254658 4881 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7366be44cfc4ea2931450c3fb4c4a8a. Latest consensus state: current_term: 1 leader_uuid: "f7366be44cfc4ea2931450c3fb4c4a8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7366be44cfc4ea2931450c3fb4c4a8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45837 } } }
I20260929 06:42:20.254741 4881 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:20.254796 4880 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7366be44cfc4ea2931450c3fb4c4a8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7366be44cfc4ea2931450c3fb4c4a8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45837 } } }
I20260929 06:42:20.254854 4880 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a [sys.catalog]: This master's current role is: LEADER
W20260929 06:42:20.255800 4897 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:42:20.255862 4897 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:42:20.255906 4890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:20.256062 4890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:20.257609 4890 catalog_manager.cc:1347] Generated new cluster ID: 627b6fc65f0b43dabbd70f7098dd7936
I20260929 06:42:20.257655 4890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:20.260272 4883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:20.254146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:52059 (local address 127.0.0.1:45837)
0929 06:42:20.254379 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:20.254388 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:20.254422 (+ 34us) server_negotiation.cc:407] Connection header received
0929 06:42:20.254551 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:20.254558 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:20.254948 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:20.255463 (+ 515us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:20.255597 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:20.256896 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:20.258106 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:20.258722 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:20.258839 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:20.259576 (+ 737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:20.259580 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:20.259580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:20.259791 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:20.259830 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:20.259847 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:20.259938 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:20.260017 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 06:42:20.260053 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":64,"threads_started":1}
I20260929 06:42:20.261320 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:20.262768 4890 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:20.263334 4890 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:20.266556 4890 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7366be44cfc4ea2931450c3fb4c4a8a: Generated new TSK 0
I20260929 06:42:20.266747 4890 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:20.269505 4883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:20.262769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:55161 (local address 127.0.0.1:45837)
0929 06:42:20.262803 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:20.262805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:20.266297 (+ 3492us) server_negotiation.cc:407] Connection header received
0929 06:42:20.266364 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:20.266365 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:20.266376 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:20.266431 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:20.266630 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:20.267245 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:20.268310 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:20.268504 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:20.268559 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:20.269221 (+ 662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:20.269222 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:20.269222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:20.269226 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:20.269238 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:20.269242 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:20.269290 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:20.269380 (+ 90us) server_negotiation.cc:299] Negotiation successful
0929 06:42:20.269391 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 06:42:20.271449 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 4808
W20260929 06:42:20.275530 4793 connection.cc:535] client connection to 127.0.0.1:45837 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45837): Connection reset by peer (error 104)
2026-09-29T06:42:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1326 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:20 dist-test-slave-ltw5 krb5kdc[4907](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:20 dist-test-slave-ltw5 krb5kdc[4907](info): set up 2 sockets
Sep 29 06:42:20 dist-test-slave-ltw5 krb5kdc[4907](info): commencing operation
krb5kdc: starting...
W20260929 06:42:21.302376 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:21 dist-test-slave-ltw5 krb5kdc[4907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:42:21.420776 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41059
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:21.500838 4920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:21.501084 4920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:21.501120 4920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:21.502269 4920 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:21.502341 4920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:21.502363 4920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:21.502384 4920 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:21.502414 4920 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:21.503852 4920 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41059
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:21.504132 4920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:21.504352 4920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:21.509258 4925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:21.509265 4926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:21.509434 4920 server_base.cc:1034] running on GCE node
W20260929 06:42:21.509275 4928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:21.509837 4920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:21.510180 4920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:21.511323 4920 hybrid_clock.cc:648] HybridClock initialized: now 1790664141511301 us; error 35 us; skew 500 ppm
Sep 29 06:42:21 dist-test-slave-ltw5 krb5kdc[4907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664141, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:21.513851 4920 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:42:21.514328 4920 webserver.cc:460] Webserver started at http://127.0.0.1:38345/ using document root <none> and password file <none>
I20260929 06:42:21.514554 4920 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:21.514598 4920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:21.514741 4920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:21.515815 4920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "5277356e97054dc8ab0fd0d1dfac4c53"
format_stamp: "Formatted at 2026-09-29 06:42:21 on dist-test-slave-ltw5"
server_key: "aa63dd5ebac548aa7d7547f3739d1e3e"
server_key_iv: "7166d61b717cddec8447f3d5ed02bf78"
server_key_version: "encryptionkey@0"
I20260929 06:42:21.516165 4920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "5277356e97054dc8ab0fd0d1dfac4c53"
format_stamp: "Formatted at 2026-09-29 06:42:21 on dist-test-slave-ltw5"
server_key: "aa63dd5ebac548aa7d7547f3739d1e3e"
server_key_iv: "7166d61b717cddec8447f3d5ed02bf78"
server_key_version: "encryptionkey@0"
I20260929 06:42:21.517504 4920 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:42:21.518309 4935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:21.518479 4920 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:42:21.518608 4920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "5277356e97054dc8ab0fd0d1dfac4c53"
format_stamp: "Formatted at 2026-09-29 06:42:21 on dist-test-slave-ltw5"
server_key: "aa63dd5ebac548aa7d7547f3739d1e3e"
server_key_iv: "7166d61b717cddec8447f3d5ed02bf78"
server_key_version: "encryptionkey@0"
I20260929 06:42:21.518662 4920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:21.521752 4920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:21.523984 4920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:21.524089 4920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:21.527892 4920 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41059
I20260929 06:42:21.527940 4987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41059 every 8 connection(s)
I20260929 06:42:21.528223 4920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:21.529032 4988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:21.531263 4988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53: Bootstrap starting.
I20260929 06:42:21.531798 4988 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:21.532078 4988 log.cc:824] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:21.532718 4988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53: No bootstrap required, opened a new log
I20260929 06:42:21.534353 4988 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5277356e97054dc8ab0fd0d1dfac4c53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41059 } }
I20260929 06:42:21.534499 4988 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:21.534543 4988 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5277356e97054dc8ab0fd0d1dfac4c53, State: Initialized, Role: FOLLOWER
I20260929 06:42:21.534698 4988 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5277356e97054dc8ab0fd0d1dfac4c53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41059 } }
I20260929 06:42:21.534789 4988 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:21.534832 4988 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:21.534880 4988 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:21.535403 4988 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5277356e97054dc8ab0fd0d1dfac4c53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41059 } }
I20260929 06:42:21.535444 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 4920
I20260929 06:42:21.535514 4988 leader_election.cc:302] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5277356e97054dc8ab0fd0d1dfac4c53; no voters:
I20260929 06:42:21.535573 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:21.535683 4988 leader_election.cc:288] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:21.535708 4991 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:21.535813 15990 external_mini_cluster.cc:1428] Setting key 8049f77490ef6280575f6dd959b73414
I20260929 06:42:21.535825 4991 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [term 1 LEADER]: Becoming Leader. State: Replica: 5277356e97054dc8ab0fd0d1dfac4c53, State: Running, Role: LEADER
I20260929 06:42:21.535897 4991 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5277356e97054dc8ab0fd0d1dfac4c53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41059 } }
I20260929 06:42:21.535939 4988 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:21.536187 4991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5277356e97054dc8ab0fd0d1dfac4c53. Latest consensus state: current_term: 1 leader_uuid: "5277356e97054dc8ab0fd0d1dfac4c53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5277356e97054dc8ab0fd0d1dfac4c53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41059 } } }
I20260929 06:42:21.536316 4991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:21.536514 4992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5277356e97054dc8ab0fd0d1dfac4c53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5277356e97054dc8ab0fd0d1dfac4c53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41059 } } }
I20260929 06:42:21.536597 4999 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:21.536630 4992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:21.537179 4999 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:21.538740 4997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:21.536324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:36239 (local address 127.0.0.1:41059)
0929 06:42:21.536559 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:21.536567 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:21.537312 (+ 745us) server_negotiation.cc:407] Connection header received
0929 06:42:21.537460 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:21.537469 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:21.537523 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:21.537666 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:21.538336 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:21.538340 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:21.538340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:21.538343 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:21.538375 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:21.538389 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:21.538452 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:21.538541 (+ 89us) server_negotiation.cc:299] Negotiation successful
0929 06:42:21.538588 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":79,"threads_started":1}
I20260929 06:42:21.539273 4999 catalog_manager.cc:1347] Generated new cluster ID: 4ce178043ae443bcaa41d40a4ed2d16d
I20260929 06:42:21.539320 4999 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:21.539667 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:21.542183 4997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:21.541128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:44617 (local address 127.0.0.1:41059)
0929 06:42:21.541161 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:21.541163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:21.541289 (+ 126us) server_negotiation.cc:407] Connection header received
0929 06:42:21.541346 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:21.541347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:21.541362 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:21.541412 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:21.541953 (+ 541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:21.541954 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:21.541955 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:21.541958 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:21.541972 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:21.541976 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:21.542038 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:21.542114 (+ 76us) server_negotiation.cc:299] Negotiation successful
0929 06:42:21.542126 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:42:21.546379 4999 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:21.546532 4999 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:21.554890 4999 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5277356e97054dc8ab0fd0d1dfac4c53: Generated new TSK 0
I20260929 06:42:21.555081 4999 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:21.559773 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 4920
2026-09-29T06:42:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1288 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:21 dist-test-slave-ltw5 krb5kdc[5019](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:21 dist-test-slave-ltw5 krb5kdc[5019](info): set up 2 sockets
Sep 29 06:42:21 dist-test-slave-ltw5 krb5kdc[5019](info): commencing operation
krb5kdc: starting...
W20260929 06:42:22.582222 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.005s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:22 dist-test-slave-ltw5 krb5kdc[5019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664142, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:42:22.704766 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:40595
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:36769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:40595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:22.784677 5032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:22.784924 5032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:22.784961 5032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:22.786126 5032 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:22.786204 5032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:22.786228 5032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:22.786248 5032 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:22.786278 5032 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:22.787748 5032 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:36769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:40595
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:40595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:22.788031 5032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:22.788266 5032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:22.792973 5037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:22.793037 5040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:22.793155 5038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:22.793164 5032 server_base.cc:1034] running on GCE node
I20260929 06:42:22.793527 5032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:22.793804 5032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:22.794981 5032 hybrid_clock.cc:648] HybridClock initialized: now 1790664142794950 us; error 68 us; skew 500 ppm
Sep 29 06:42:22 dist-test-slave-ltw5 krb5kdc[5019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664142, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:22.797307 5032 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:42:22.797746 5032 webserver.cc:460] Webserver started at http://127.15.157.190:34273/ using document root <none> and password file <none>
I20260929 06:42:22.797973 5032 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:22.798065 5032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:22.798218 5032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:22.799249 5032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "0b5d97d1b36b4e82bf8187237223f134"
format_stamp: "Formatted at 2026-09-29 06:42:22 on dist-test-slave-ltw5"
server_key: "c45444778d45673f7177b28b6e047cac"
server_key_iv: "f726fea8db165e7301b4e6026fc62389"
server_key_version: "encryptionkey@0"
I20260929 06:42:22.799613 5032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "0b5d97d1b36b4e82bf8187237223f134"
format_stamp: "Formatted at 2026-09-29 06:42:22 on dist-test-slave-ltw5"
server_key: "c45444778d45673f7177b28b6e047cac"
server_key_iv: "f726fea8db165e7301b4e6026fc62389"
server_key_version: "encryptionkey@0"
I20260929 06:42:22.800908 5032 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:42:22.801652 5047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:22.801855 5032 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:22.801951 5032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "0b5d97d1b36b4e82bf8187237223f134"
format_stamp: "Formatted at 2026-09-29 06:42:22 on dist-test-slave-ltw5"
server_key: "c45444778d45673f7177b28b6e047cac"
server_key_iv: "f726fea8db165e7301b4e6026fc62389"
server_key_version: "encryptionkey@0"
I20260929 06:42:22.802059 5032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:22.814752 5032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:22.816545 5032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:22.816711 5032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:22.820827 5032 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:40595
I20260929 06:42:22.820874 5099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:40595 every 8 connection(s)
I20260929 06:42:22.821231 5032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:22.822208 5100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:22.824429 5100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134: Bootstrap starting.
I20260929 06:42:22.825001 5100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:22.825291 5100 log.cc:824] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:22.825981 5100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134: No bootstrap required, opened a new log
I20260929 06:42:22.827626 5100 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b5d97d1b36b4e82bf8187237223f134" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40595 } }
I20260929 06:42:22.827764 5100 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:22.827785 5100 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5d97d1b36b4e82bf8187237223f134, State: Initialized, Role: FOLLOWER
I20260929 06:42:22.827970 5100 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b5d97d1b36b4e82bf8187237223f134" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40595 } }
I20260929 06:42:22.828035 5100 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:22.828058 5100 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:22.828125 5100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:22.828933 5100 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b5d97d1b36b4e82bf8187237223f134" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40595 } }
I20260929 06:42:22.829047 5100 leader_election.cc:302] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b5d97d1b36b4e82bf8187237223f134; no voters:
I20260929 06:42:22.829244 5100 leader_election.cc:288] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:22.829356 5103 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:22.829507 5100 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:22.829535 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 5032
I20260929 06:42:22.829648 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:22.829538 5103 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5d97d1b36b4e82bf8187237223f134, State: Running, Role: LEADER
I20260929 06:42:22.829862 15990 external_mini_cluster.cc:1428] Setting key ee7e6e5da76f4d155b5d98a1442e5686
I20260929 06:42:22.829869 5103 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b5d97d1b36b4e82bf8187237223f134" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40595 } }
I20260929 06:42:22.830286 5104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b5d97d1b36b4e82bf8187237223f134" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b5d97d1b36b4e82bf8187237223f134" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40595 } } }
I20260929 06:42:22.830371 5104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:22.830524 5105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b5d97d1b36b4e82bf8187237223f134. Latest consensus state: current_term: 1 leader_uuid: "0b5d97d1b36b4e82bf8187237223f134" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b5d97d1b36b4e82bf8187237223f134" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 40595 } } }
I20260929 06:42:22.830592 5105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134 [sys.catalog]: This master's current role is: LEADER
W20260929 06:42:22.831466 5121 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:42:22.831574 5121 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:42:22.831646 5113 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:22.831873 5113 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:22.833416 5113 catalog_manager.cc:1347] Generated new cluster ID: 9f87633bcc8d4ad5b0e02362d4f12a6a
I20260929 06:42:22.833467 5113 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:42:22 dist-test-slave-ltw5 krb5kdc[5019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664142, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:22.838562 5113 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:22.839243 5113 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:22.844187 5114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:22.830520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37919 (local address 127.15.157.190:40595)
0929 06:42:22.830882 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:22.830892 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:22.831032 (+ 140us) server_negotiation.cc:407] Connection header received
0929 06:42:22.831291 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:22.831297 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:22.831339 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:22.831473 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:22.832210 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:22.833373 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:22.834216 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:22.834643 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:22.834771 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:22.837132 (+ 2361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:22.837136 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:22.837136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:22.837148 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:22.842596 (+ 5448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:22.843029 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:22.843033 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:22.843033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:22.843137 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:22.843374 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:22.843375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:22.843375 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:22.843595 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:22.843773 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:22.843860 (+ 87us) server_negotiation.cc:299] Negotiation successful
0929 06:42:22.843963 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":75,"threads_started":1}
I20260929 06:42:22.845299 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:22.845439 5113 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b5d97d1b36b4e82bf8187237223f134: Generated new TSK 0
I20260929 06:42:22.845593 5113 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:22.853339 5114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:22.846766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37799 (local address 127.15.157.190:40595)
0929 06:42:22.846805 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:22.846807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:22.846936 (+ 129us) server_negotiation.cc:407] Connection header received
0929 06:42:22.846986 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:22.846987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:22.846994 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:22.847039 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:22.847652 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:22.848153 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:22.849210 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:22.849399 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:22.849454 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:22.850820 (+ 1366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:22.850821 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:22.850822 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:22.850827 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:22.852221 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:22.852632 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:22.852633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:22.852633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:22.852684 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:22.852912 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:22.852912 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:22.852912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:22.853002 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:22.853090 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:22.853233 (+ 143us) server_negotiation.cc:299] Negotiation successful
0929 06:42:22.853281 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:42:22.855592 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 5032
W20260929 06:42:22.859915 5017 connection.cc:535] client connection to 127.15.157.190:40595 recv error: Network error: failed to read from TLS socket (remote: 127.15.157.190:40595): Connection reset by peer (error 104)
2026-09-29T06:42:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1295 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:22 dist-test-slave-ltw5 krb5kdc[5131](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:22 dist-test-slave-ltw5 krb5kdc[5131](info): set up 2 sockets
Sep 29 06:42:22 dist-test-slave-ltw5 krb5kdc[5131](info): commencing operation
krb5kdc: starting...
W20260929 06:42:23.894161 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:23 dist-test-slave-ltw5 krb5kdc[5131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664143, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:42:24.013037 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:41281
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:41281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:24.094427 5144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:24.094625 5144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:24.094646 5144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:24.095783 5144 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:24.095824 5144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:24.095839 5144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:24.095897 5144 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:24.095914 5144 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:24.097338 5144 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:41281
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:41281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:24.097585 5144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:24.097803 5144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:24.102522 5149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:24.102660 5150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:24.102587 5152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:24.102643 5144 server_base.cc:1034] running on GCE node
I20260929 06:42:24.102936 5144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:24.103225 5144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:24.104372 5144 hybrid_clock.cc:648] HybridClock initialized: now 1790664144104351 us; error 37 us; skew 500 ppm
Sep 29 06:42:24 dist-test-slave-ltw5 krb5kdc[5131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664144, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:24.106916 5144 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:42:24.107334 5144 webserver.cc:460] Webserver started at http://127.15.157.190:34537/ using document root <none> and password file <none>
I20260929 06:42:24.107503 5144 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:24.107540 5144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:24.107633 5144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:24.108588 5144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "9831681818fd4c44978fdca470f24eae"
format_stamp: "Formatted at 2026-09-29 06:42:24 on dist-test-slave-ltw5"
server_key: "89764921f410667a7ebced7d461df1f7"
server_key_iv: "1c91960dce409e9e50184dc4f61baa11"
server_key_version: "encryptionkey@0"
I20260929 06:42:24.108891 5144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "9831681818fd4c44978fdca470f24eae"
format_stamp: "Formatted at 2026-09-29 06:42:24 on dist-test-slave-ltw5"
server_key: "89764921f410667a7ebced7d461df1f7"
server_key_iv: "1c91960dce409e9e50184dc4f61baa11"
server_key_version: "encryptionkey@0"
I20260929 06:42:24.110157 5144 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:42:24.110836 5159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:24.111008 5144 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:42:24.111105 5144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "9831681818fd4c44978fdca470f24eae"
format_stamp: "Formatted at 2026-09-29 06:42:24 on dist-test-slave-ltw5"
server_key: "89764921f410667a7ebced7d461df1f7"
server_key_iv: "1c91960dce409e9e50184dc4f61baa11"
server_key_version: "encryptionkey@0"
I20260929 06:42:24.111186 5144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:24.128682 5144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:24.130577 5144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:24.130684 5144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:24.134394 5144 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:41281
I20260929 06:42:24.134450 5211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:41281 every 8 connection(s)
I20260929 06:42:24.134804 5144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:24.135676 5212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:24.137707 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 5144
I20260929 06:42:24.137844 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:24.137925 5212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae: Bootstrap starting.
I20260929 06:42:24.138078 15990 external_mini_cluster.cc:1428] Setting key a35c630bde3a4c505496c7576c37dbdd
I20260929 06:42:24.138688 5212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:24.139081 5212 log.cc:824] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:24.139861 5212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae: No bootstrap required, opened a new log
I20260929 06:42:24.142141 5212 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9831681818fd4c44978fdca470f24eae" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41281 } }
I20260929 06:42:24.142306 5212 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:24.142336 5212 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9831681818fd4c44978fdca470f24eae, State: Initialized, Role: FOLLOWER
I20260929 06:42:24.142447 5212 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9831681818fd4c44978fdca470f24eae" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41281 } }
I20260929 06:42:24.142516 5212 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:24.142544 5212 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:24.142588 5212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:24.143237 5212 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9831681818fd4c44978fdca470f24eae" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41281 } }
I20260929 06:42:24.143361 5212 leader_election.cc:302] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9831681818fd4c44978fdca470f24eae; no voters:
I20260929 06:42:24.143545 5212 leader_election.cc:288] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:24.143579 5217 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:24.143738 5217 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [term 1 LEADER]: Becoming Leader. State: Replica: 9831681818fd4c44978fdca470f24eae, State: Running, Role: LEADER
I20260929 06:42:24.143795 5212 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:24.143862 5217 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9831681818fd4c44978fdca470f24eae" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41281 } }
I20260929 06:42:24.144224 5217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9831681818fd4c44978fdca470f24eae. Latest consensus state: current_term: 1 leader_uuid: "9831681818fd4c44978fdca470f24eae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9831681818fd4c44978fdca470f24eae" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41281 } } }
I20260929 06:42:24.144234 5219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9831681818fd4c44978fdca470f24eae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9831681818fd4c44978fdca470f24eae" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41281 } } }
I20260929 06:42:24.144359 5219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:24.144539 5215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:24.138621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51097 (local address 127.15.157.190:41281)
0929 06:42:24.138826 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:24.138836 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:24.138874 (+ 38us) server_negotiation.cc:407] Connection header received
0929 06:42:24.139481 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:24.139489 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:24.139586 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:24.139734 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:24.139929 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:24.141312 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:24.142152 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:24.142763 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:24.142872 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:24.143602 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:24.143606 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:24.143607 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:24.143809 (+ 202us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:24.143845 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:24.143861 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:24.143950 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:24.144201 (+ 251us) server_negotiation.cc:299] Negotiation successful
0929 06:42:24.144230 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":88,"threads_started":1}
I20260929 06:42:24.144318 5217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:24.145773 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260929 06:42:24.145896 5233 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:42:24.145931 5233 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:42:24.146004 5225 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:24.146217 5225 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:24.147733 5225 catalog_manager.cc:1347] Generated new cluster ID: dce3a63840624b03a7aa5f693b95ea14
I20260929 06:42:24.147781 5225 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:24.150239 5215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:24.147298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52005 (local address 127.15.157.190:41281)
0929 06:42:24.147348 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:24.147350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:24.147516 (+ 166us) server_negotiation.cc:407] Connection header received
0929 06:42:24.147560 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:24.147561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:24.147571 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:24.147638 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:24.147834 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:24.148298 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:24.148974 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:24.149207 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:24.149303 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:24.149975 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:24.149977 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:24.149977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:24.149982 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:24.149995 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:24.149999 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:24.150092 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:24.150157 (+ 65us) server_negotiation.cc:299] Negotiation successful
0929 06:42:24.150166 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 06:42:24.170570 5225 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:24.171152 5225 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:24.183694 5225 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9831681818fd4c44978fdca470f24eae: Generated new TSK 0
I20260929 06:42:24.183907 5225 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:24.190570 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 5144
W20260929 06:42:24.194721 5129 connection.cc:535] client connection to 127.15.157.190:41281 recv error: Network error: failed to read from TLS socket (remote: 127.15.157.190:41281): Connection reset by peer (error 104)
2026-09-29T06:42:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1334 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:24 dist-test-slave-ltw5 krb5kdc[5243](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:24 dist-test-slave-ltw5 krb5kdc[5243](info): set up 2 sockets
Sep 29 06:42:24 dist-test-slave-ltw5 krb5kdc[5243](info): commencing operation
krb5kdc: starting...
W20260929 06:42:25.218300 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.010s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:25 dist-test-slave-ltw5 krb5kdc[5243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:42:25.334373 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:41717
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:44151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:41717
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:25.413455 5256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:25.413751 5256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:25.413791 5256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:25.414973 5256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:25.415048 5256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:25.415072 5256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:25.415092 5256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:25.415122 5256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:25.416611 5256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:44151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:41717
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:41717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:25.416885 5256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:25.417117 5256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:25.422304 5264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:25.422310 5262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:25.422319 5256 server_base.cc:1034] running on GCE node
W20260929 06:42:25.422526 5261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:25.422783 5256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:25.423029 5256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:25.424168 5256 hybrid_clock.cc:648] HybridClock initialized: now 1790664145424152 us; error 31 us; skew 500 ppm
Sep 29 06:42:25 dist-test-slave-ltw5 krb5kdc[5243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664145, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:25.431958 5256 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:42:25.432466 5256 webserver.cc:460] Webserver started at http://127.15.157.190:46233/ using document root <none> and password file <none>
I20260929 06:42:25.432700 5256 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:25.432770 5256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:25.432924 5256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:25.434090 5256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "73022e46622c4682ad8702ea248f5d9b"
format_stamp: "Formatted at 2026-09-29 06:42:25 on dist-test-slave-ltw5"
server_key: "be0e59ad11201280b8059db7b2765fec"
server_key_iv: "1087a0fa0f9e121ed7324036e88c5b43"
server_key_version: "encryptionkey@0"
I20260929 06:42:25.434482 5256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "73022e46622c4682ad8702ea248f5d9b"
format_stamp: "Formatted at 2026-09-29 06:42:25 on dist-test-slave-ltw5"
server_key: "be0e59ad11201280b8059db7b2765fec"
server_key_iv: "1087a0fa0f9e121ed7324036e88c5b43"
server_key_version: "encryptionkey@0"
I20260929 06:42:25.435858 5256 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:42:25.436607 5271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:25.436776 5256 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:42:25.436884 5256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "73022e46622c4682ad8702ea248f5d9b"
format_stamp: "Formatted at 2026-09-29 06:42:25 on dist-test-slave-ltw5"
server_key: "be0e59ad11201280b8059db7b2765fec"
server_key_iv: "1087a0fa0f9e121ed7324036e88c5b43"
server_key_version: "encryptionkey@0"
I20260929 06:42:25.436959 5256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:25.440290 5256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:25.442607 5256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:25.442767 5256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:25.446997 5256 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:41717
I20260929 06:42:25.447046 5323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:41717 every 8 connection(s)
I20260929 06:42:25.447372 5256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:25.448313 5324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:25.448565 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 5256
I20260929 06:42:25.448701 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:25.448884 15990 external_mini_cluster.cc:1428] Setting key 942473873b0a38aa922fb79d985c75c6
I20260929 06:42:25.451293 5327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:25.449408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33817 (local address 127.15.157.190:41717)
0929 06:42:25.449596 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:25.449603 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:25.449628 (+ 25us) server_negotiation.cc:407] Connection header received
0929 06:42:25.450101 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:25.450108 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:25.450135 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:25.450251 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:25.450863 (+ 612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:25.450866 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:25.450866 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:25.450870 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:25.450906 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:25.450916 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:25.450971 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:25.451066 (+ 95us) server_negotiation.cc:299] Negotiation successful
0929 06:42:25.451121 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
I20260929 06:42:25.451347 5324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b: Bootstrap starting.
I20260929 06:42:25.452001 5324 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:25.452176 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:25.452330 5324 log.cc:824] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:25.453073 5324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b: No bootstrap required, opened a new log
I20260929 06:42:25.454710 5327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:25.453685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60867 (local address 127.15.157.190:41717)
0929 06:42:25.453736 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:25.453738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:25.453868 (+ 130us) server_negotiation.cc:407] Connection header received
0929 06:42:25.453923 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:25.453924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:25.453928 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:25.453972 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:25.454478 (+ 506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:25.454479 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:25.454479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:25.454482 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:25.454493 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:25.454496 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:25.454537 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:25.454612 (+ 75us) server_negotiation.cc:299] Negotiation successful
0929 06:42:25.454622 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 06:42:25.455660 5324 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73022e46622c4682ad8702ea248f5d9b" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41717 } }
I20260929 06:42:25.455793 5324 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:25.455816 5324 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73022e46622c4682ad8702ea248f5d9b, State: Initialized, Role: FOLLOWER
I20260929 06:42:25.455922 5324 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73022e46622c4682ad8702ea248f5d9b" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41717 } }
I20260929 06:42:25.456013 5324 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:25.456035 5324 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:25.456063 5324 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:25.456519 5324 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73022e46622c4682ad8702ea248f5d9b" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41717 } }
I20260929 06:42:25.456598 5324 leader_election.cc:302] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73022e46622c4682ad8702ea248f5d9b; no voters:
I20260929 06:42:25.456709 5324 leader_election.cc:288] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:25.456774 5334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:25.456914 5334 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [term 1 LEADER]: Becoming Leader. State: Replica: 73022e46622c4682ad8702ea248f5d9b, State: Running, Role: LEADER
I20260929 06:42:25.456933 5324 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:25.457031 5334 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73022e46622c4682ad8702ea248f5d9b" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41717 } }
I20260929 06:42:25.457365 5335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73022e46622c4682ad8702ea248f5d9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73022e46622c4682ad8702ea248f5d9b" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41717 } } }
I20260929 06:42:25.457373 5336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73022e46622c4682ad8702ea248f5d9b. Latest consensus state: current_term: 1 leader_uuid: "73022e46622c4682ad8702ea248f5d9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73022e46622c4682ad8702ea248f5d9b" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 41717 } } }
I20260929 06:42:25.457477 5335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:25.457484 5336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:25.457715 5341 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:25.458247 5341 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:25.459779 5341 catalog_manager.cc:1347] Generated new cluster ID: f01d2ac224144b16871204fd1bed291f
I20260929 06:42:25.459831 5341 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:25.467958 5341 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:25.468143 5341 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:25.481086 5341 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73022e46622c4682ad8702ea248f5d9b: Generated new TSK 0
I20260929 06:42:25.481315 5341 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:25.490468 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 5256
2026-09-29T06:42:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1299 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:25 dist-test-slave-ltw5 krb5kdc[5355](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:25 dist-test-slave-ltw5 krb5kdc[5355](info): set up 2 sockets
Sep 29 06:42:25 dist-test-slave-ltw5 krb5kdc[5355](info): commencing operation
krb5kdc: starting...
W20260929 06:42:26.526314 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:26 dist-test-slave-ltw5 krb5kdc[5355](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664146, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:42:26.644469 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:32927
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:38643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:32927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:26.722903 5368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:26.723176 5368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:26.723220 5368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:26.724386 5368 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:26.724459 5368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:26.724483 5368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:26.724511 5368 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:26.724542 5368 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:26.725986 5368 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:38643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:32927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:32927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:26.726286 5368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:26.726513 5368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:26.731359 5376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:26.731335 5373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:26.731335 5374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:26.731491 5368 server_base.cc:1034] running on GCE node
I20260929 06:42:26.731925 5368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:26.732220 5368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:26.733397 5368 hybrid_clock.cc:648] HybridClock initialized: now 1790664146733380 us; error 48 us; skew 500 ppm
Sep 29 06:42:26 dist-test-slave-ltw5 krb5kdc[5355](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664146, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:26.735865 5368 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:42:26.736302 5368 webserver.cc:460] Webserver started at http://127.15.157.190:34245/ using document root <none> and password file <none>
I20260929 06:42:26.736547 5368 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:26.736619 5368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:26.736765 5368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:26.737802 5368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "05d3056945c948da8e0581459330bc56"
format_stamp: "Formatted at 2026-09-29 06:42:26 on dist-test-slave-ltw5"
server_key: "be8201149110adc2d8075bd8512af26f"
server_key_iv: "a769d0e066fd8db9b4dec16e1a3953ee"
server_key_version: "encryptionkey@0"
I20260929 06:42:26.738204 5368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "05d3056945c948da8e0581459330bc56"
format_stamp: "Formatted at 2026-09-29 06:42:26 on dist-test-slave-ltw5"
server_key: "be8201149110adc2d8075bd8512af26f"
server_key_iv: "a769d0e066fd8db9b4dec16e1a3953ee"
server_key_version: "encryptionkey@0"
I20260929 06:42:26.739490 5368 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:42:26.740356 5383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:26.740527 5368 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:42:26.740617 5368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "05d3056945c948da8e0581459330bc56"
format_stamp: "Formatted at 2026-09-29 06:42:26 on dist-test-slave-ltw5"
server_key: "be8201149110adc2d8075bd8512af26f"
server_key_iv: "a769d0e066fd8db9b4dec16e1a3953ee"
server_key_version: "encryptionkey@0"
I20260929 06:42:26.740689 5368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:26.761473 5368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:26.763343 5368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:26.763512 5368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:26.767354 5368 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:32927
I20260929 06:42:26.767390 5435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:32927 every 8 connection(s)
I20260929 06:42:26.767755 5368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:26.768615 5436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:26.768884 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 5368
I20260929 06:42:26.769007 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:26.769223 15990 external_mini_cluster.cc:1428] Setting key 94a82b3ebb3a87e8f22d71f27b00d845
I20260929 06:42:26.772015 5436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56: Bootstrap starting.
I20260929 06:42:26.772692 5436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:26.772990 5436 log.cc:824] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:26.773727 5436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56: No bootstrap required, opened a new log
Sep 29 06:42:26 dist-test-slave-ltw5 krb5kdc[5355](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664146, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:26.776338 5436 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05d3056945c948da8e0581459330bc56" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 32927 } }
I20260929 06:42:26.776535 5436 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:26.776582 5436 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d3056945c948da8e0581459330bc56, State: Initialized, Role: FOLLOWER
I20260929 06:42:26.776732 5436 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05d3056945c948da8e0581459330bc56" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 32927 } }
I20260929 06:42:26.776825 5436 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:26.776863 5436 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:26.776908 5436 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:26.777427 5436 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05d3056945c948da8e0581459330bc56" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 32927 } }
I20260929 06:42:26.777545 5436 leader_election.cc:302] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05d3056945c948da8e0581459330bc56; no voters:
I20260929 06:42:26.777724 5436 leader_election.cc:288] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:26.777801 5441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:26.777921 5441 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [term 1 LEADER]: Becoming Leader. State: Replica: 05d3056945c948da8e0581459330bc56, State: Running, Role: LEADER
I20260929 06:42:26.777992 5436 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:26.778012 5441 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05d3056945c948da8e0581459330bc56" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 32927 } }
I20260929 06:42:26.778422 5441 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05d3056945c948da8e0581459330bc56. Latest consensus state: current_term: 1 leader_uuid: "05d3056945c948da8e0581459330bc56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05d3056945c948da8e0581459330bc56" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 32927 } } }
I20260929 06:42:26.778575 5441 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:26.779021 5450 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:26.779270 5442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05d3056945c948da8e0581459330bc56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05d3056945c948da8e0581459330bc56" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 32927 } } }
I20260929 06:42:26.779572 5450 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:26.780925 5439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:26.769759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35471 (local address 127.15.157.190:32927)
0929 06:42:26.769916 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:26.769925 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:26.769959 (+ 34us) server_negotiation.cc:407] Connection header received
0929 06:42:26.770430 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:26.770436 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:26.770483 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:26.770629 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:26.771424 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:26.772446 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:26.773520 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:26.774002 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:26.774145 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:26.776899 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:26.776903 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:26.776904 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:26.776917 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:26.778962 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:26.779379 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:26.779383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:26.779383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:26.779484 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:26.779712 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:26.779713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:26.779713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:26.780011 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:26.780169 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:26.780581 (+ 412us) server_negotiation.cc:299] Negotiation successful
0929 06:42:26.780723 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":76,"threads_started":1}
I20260929 06:42:26.779587 5442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:26.781148 5450 catalog_manager.cc:1347] Generated new cluster ID: ba7392d5619b4c03856deb33ae9e30af
I20260929 06:42:26.781193 5450 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:26.781992 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:26.790733 5439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:26.783471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52305 (local address 127.15.157.190:32927)
0929 06:42:26.783507 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:26.783509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:26.783643 (+ 134us) server_negotiation.cc:407] Connection header received
0929 06:42:26.783700 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:26.783700 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:26.783710 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:26.783759 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:26.784372 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:26.785179 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:26.786288 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:26.786625 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:26.786683 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:26.788047 (+ 1364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:26.788048 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:26.788048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:26.788054 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:26.789571 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:26.789958 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:26.789959 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:26.789960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:26.790012 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:26.790237 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:26.790238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:26.790238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:26.790353 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:26.790436 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:26.790574 (+ 138us) server_negotiation.cc:299] Negotiation successful
0929 06:42:26.790647 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:42:26.801008 5450 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:26.801483 5450 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:26.805401 5450 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05d3056945c948da8e0581459330bc56: Generated new TSK 0
I20260929 06:42:26.805575 5450 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:26.807490 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 5368
2026-09-29T06:42:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1316 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:26 dist-test-slave-ltw5 krb5kdc[5467](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:26 dist-test-slave-ltw5 krb5kdc[5467](info): set up 2 sockets
Sep 29 06:42:26 dist-test-slave-ltw5 krb5kdc[5467](info): commencing operation
krb5kdc: starting...
W20260929 06:42:27.838186 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:27 dist-test-slave-ltw5 krb5kdc[5467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:42:27.954847 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:39273
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:39267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:39273
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:28.034888 5480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:28.035085 5480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:28.035109 5480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:28.036286 5480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:28.036331 5480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:28.036346 5480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:28.036360 5480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:28.036417 5480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:28.037891 5480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:39267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:39273
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:39273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:28.038156 5480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:28.038419 5480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:28.043277 5486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:28.043264 5485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:28.043437 5480 server_base.cc:1034] running on GCE node
W20260929 06:42:28.043246 5488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:28.043712 5480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:28.043958 5480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:28.045106 5480 hybrid_clock.cc:648] HybridClock initialized: now 1790664148045086 us; error 35 us; skew 500 ppm
Sep 29 06:42:28 dist-test-slave-ltw5 krb5kdc[5467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664148, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:28.047655 5480 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:42:28.048120 5480 webserver.cc:460] Webserver started at http://127.15.157.190:35141/ using document root <none> and password file <none>
I20260929 06:42:28.048373 5480 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:28.048421 5480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:28.048553 5480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:28.049647 5480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "2fd27852a9e941fe9c8c18ed4c480a28"
format_stamp: "Formatted at 2026-09-29 06:42:28 on dist-test-slave-ltw5"
server_key: "ff51fba224bf9620b6fcb2e85be0ab8b"
server_key_iv: "5c2d45fd80ea2e9f5185a4919358ee47"
server_key_version: "encryptionkey@0"
I20260929 06:42:28.050004 5480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "2fd27852a9e941fe9c8c18ed4c480a28"
format_stamp: "Formatted at 2026-09-29 06:42:28 on dist-test-slave-ltw5"
server_key: "ff51fba224bf9620b6fcb2e85be0ab8b"
server_key_iv: "5c2d45fd80ea2e9f5185a4919358ee47"
server_key_version: "encryptionkey@0"
I20260929 06:42:28.051398 5480 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:42:28.052189 5495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:28.052404 5480 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:42:28.052486 5480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "2fd27852a9e941fe9c8c18ed4c480a28"
format_stamp: "Formatted at 2026-09-29 06:42:28 on dist-test-slave-ltw5"
server_key: "ff51fba224bf9620b6fcb2e85be0ab8b"
server_key_iv: "5c2d45fd80ea2e9f5185a4919358ee47"
server_key_version: "encryptionkey@0"
I20260929 06:42:28.052575 5480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:28.071087 5480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:28.073503 5480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:28.073663 5480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:28.077884 5480 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:39273
I20260929 06:42:28.077919 5547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:39273 every 8 connection(s)
I20260929 06:42:28.078310 5480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:28.079164 5548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:28.079242 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 5480
I20260929 06:42:28.079365 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:28.079579 15990 external_mini_cluster.cc:1428] Setting key d57bd1880e95bc0a9cd698c271ca81a1
I20260929 06:42:28.082705 5548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28: Bootstrap starting.
I20260929 06:42:28.083326 5548 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:28.083629 5548 log.cc:824] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:28.084378 5548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28: No bootstrap required, opened a new log
I20260929 06:42:28.085592 5551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:28.080101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58295 (local address 127.15.157.190:39273)
0929 06:42:28.080297 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:28.080307 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:28.080341 (+ 34us) server_negotiation.cc:407] Connection header received
0929 06:42:28.080839 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:28.080847 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:28.080912 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:28.081070 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:28.081290 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:28.082676 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:28.083553 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:28.084105 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:28.084212 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:28.084918 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:28.084923 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:28.084923 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:28.085120 (+ 197us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:28.085160 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:28.085174 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:28.085242 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:28.085307 (+ 65us) server_negotiation.cc:299] Negotiation successful
0929 06:42:28.085375 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":92,"threads_started":1}
I20260929 06:42:28.086623 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:28.086802 5548 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd27852a9e941fe9c8c18ed4c480a28" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 39273 } }
I20260929 06:42:28.086958 5548 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:28.086988 5548 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fd27852a9e941fe9c8c18ed4c480a28, State: Initialized, Role: FOLLOWER
I20260929 06:42:28.087118 5548 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd27852a9e941fe9c8c18ed4c480a28" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 39273 } }
I20260929 06:42:28.087194 5548 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:28.087224 5548 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:28.087270 5548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:28.087999 5548 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd27852a9e941fe9c8c18ed4c480a28" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 39273 } }
I20260929 06:42:28.088127 5548 leader_election.cc:302] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fd27852a9e941fe9c8c18ed4c480a28; no voters:
I20260929 06:42:28.088286 5548 leader_election.cc:288] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:28.088315 5558 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:28.088429 5558 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [term 1 LEADER]: Becoming Leader. State: Replica: 2fd27852a9e941fe9c8c18ed4c480a28, State: Running, Role: LEADER
I20260929 06:42:28.088506 5558 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd27852a9e941fe9c8c18ed4c480a28" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 39273 } }
I20260929 06:42:28.088536 5548 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:28.088860 5558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fd27852a9e941fe9c8c18ed4c480a28. Latest consensus state: current_term: 1 leader_uuid: "2fd27852a9e941fe9c8c18ed4c480a28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd27852a9e941fe9c8c18ed4c480a28" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 39273 } } }
I20260929 06:42:28.088869 5559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fd27852a9e941fe9c8c18ed4c480a28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd27852a9e941fe9c8c18ed4c480a28" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 39273 } } }
I20260929 06:42:28.088938 5558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:28.088990 5559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:28.089190 5564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:28.089705 5564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:28.091362 5564 catalog_manager.cc:1347] Generated new cluster ID: 28015cd213fa4d4a9be24674640cb340
I20260929 06:42:28.091423 5564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:28.091842 5551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:28.088112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51323 (local address 127.15.157.190:39273)
0929 06:42:28.088165 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:28.088167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:28.088246 (+ 79us) server_negotiation.cc:407] Connection header received
0929 06:42:28.088316 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:28.088318 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:28.088382 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:28.088436 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:28.088687 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:28.089538 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:28.090473 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:28.090684 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:28.090770 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:28.091462 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:28.091464 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:28.091464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:28.091468 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:28.091482 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:28.091486 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:28.091741 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:28.091756 (+ 15us) server_negotiation.cc:299] Negotiation successful
0929 06:42:28.091776 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 06:42:28.103117 5564 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:28.103850 5564 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:28.114720 5564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fd27852a9e941fe9c8c18ed4c480a28: Generated new TSK 0
I20260929 06:42:28.114934 5564 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:28.119088 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 5480
2026-09-29T06:42:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1311 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:28 dist-test-slave-ltw5 krb5kdc[5579](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:28 dist-test-slave-ltw5 krb5kdc[5579](info): set up 2 sockets
Sep 29 06:42:28 dist-test-slave-ltw5 krb5kdc[5579](info): commencing operation
krb5kdc: starting...
W20260929 06:42:29.150354 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:29 dist-test-slave-ltw5 krb5kdc[5579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:42:29.266276 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:34573
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:34407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:34573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:29.345837 5592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:29.346107 5592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:29.346146 5592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:29.347293 5592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:29.347368 5592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:29.347391 5592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:29.347421 5592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:29.347452 5592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:29.348896 5592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:34407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:34573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:34573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:29.349174 5592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:29.349397 5592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:29.354259 5597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:29.354307 5598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:29.354259 5600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:29.354511 5592 server_base.cc:1034] running on GCE node
I20260929 06:42:29.354818 5592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:29.355159 5592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:29.356330 5592 hybrid_clock.cc:648] HybridClock initialized: now 1790664149356310 us; error 37 us; skew 500 ppm
Sep 29 06:42:29 dist-test-slave-ltw5 krb5kdc[5579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664149, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:29.358794 5592 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:42:29.359267 5592 webserver.cc:460] Webserver started at http://127.15.157.190:45129/ using document root <none> and password file <none>
I20260929 06:42:29.359488 5592 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:29.359563 5592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:29.359714 5592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:29.360824 5592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "2e0a60dae13344b494339aec4ce27246"
format_stamp: "Formatted at 2026-09-29 06:42:29 on dist-test-slave-ltw5"
server_key: "a2ef5ef3f93c76257e4733ac6b70cf03"
server_key_iv: "e6dc2fbb6bd044b0fceb6196638ceb17"
server_key_version: "encryptionkey@0"
I20260929 06:42:29.361182 5592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "2e0a60dae13344b494339aec4ce27246"
format_stamp: "Formatted at 2026-09-29 06:42:29 on dist-test-slave-ltw5"
server_key: "a2ef5ef3f93c76257e4733ac6b70cf03"
server_key_iv: "e6dc2fbb6bd044b0fceb6196638ceb17"
server_key_version: "encryptionkey@0"
I20260929 06:42:29.362612 5592 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260929 06:42:29.363372 5607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:29.363586 5592 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:29.363696 5592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "2e0a60dae13344b494339aec4ce27246"
format_stamp: "Formatted at 2026-09-29 06:42:29 on dist-test-slave-ltw5"
server_key: "a2ef5ef3f93c76257e4733ac6b70cf03"
server_key_iv: "e6dc2fbb6bd044b0fceb6196638ceb17"
server_key_version: "encryptionkey@0"
I20260929 06:42:29.363785 5592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:29.367178 5592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:29.369266 5592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:29.369421 5592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:29.373430 5592 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:34573
I20260929 06:42:29.373473 5659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:34573 every 8 connection(s)
I20260929 06:42:29.373835 5592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:29.374818 5660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:29.377094 5660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246: Bootstrap starting.
I20260929 06:42:29.377676 5660 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:29.378005 5660 log.cc:824] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:29.378913 5660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246: No bootstrap required, opened a new log
I20260929 06:42:29.380491 5660 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0a60dae13344b494339aec4ce27246" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34573 } }
I20260929 06:42:29.380635 5660 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:42:29.380657 5660 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e0a60dae13344b494339aec4ce27246, State: Initialized, Role: FOLLOWER
I20260929 06:42:29.380707 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 5592
I20260929 06:42:29.380831 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:29.380807 5660 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0a60dae13344b494339aec4ce27246" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34573 } }
I20260929 06:42:29.380894 5660 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:42:29.380934 5660 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:42:29.380983 5660 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:29.381033 15990 external_mini_cluster.cc:1428] Setting key 88c574d9d3165c0f546d1986415ae529
I20260929 06:42:29.382179 5660 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0a60dae13344b494339aec4ce27246" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34573 } }
I20260929 06:42:29.382296 5660 leader_election.cc:302] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e0a60dae13344b494339aec4ce27246; no voters:
I20260929 06:42:29.382458 5660 leader_election.cc:288] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:42:29.382490 5665 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:29.382725 5660 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:29.383510 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:29.381563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57955 (local address 127.15.157.190:34573)
0929 06:42:29.381749 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:29.381757 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:29.381783 (+ 26us) server_negotiation.cc:407] Connection header received
0929 06:42:29.381885 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:29.381891 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:29.381914 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:29.382131 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:29.382842 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:29.382845 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:29.382845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:29.382849 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:29.382893 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:29.382909 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:29.382972 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:29.383174 (+ 202us) server_negotiation.cc:299] Negotiation successful
0929 06:42:29.383257 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":97,"threads_started":1}
I20260929 06:42:29.383961 5665 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [term 1 LEADER]: Becoming Leader. State: Replica: 2e0a60dae13344b494339aec4ce27246, State: Running, Role: LEADER
I20260929 06:42:29.384065 5665 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0a60dae13344b494339aec4ce27246" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34573 } }
I20260929 06:42:29.384454 5667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e0a60dae13344b494339aec4ce27246. Latest consensus state: current_term: 1 leader_uuid: "2e0a60dae13344b494339aec4ce27246" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0a60dae13344b494339aec4ce27246" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34573 } } }
I20260929 06:42:29.384554 5667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:29.384630 5666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e0a60dae13344b494339aec4ce27246" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0a60dae13344b494339aec4ce27246" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 34573 } } }
I20260929 06:42:29.384698 5666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:29.384775 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:29.385584 5674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:29.386135 5674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:29.387583 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:29.386392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33851 (local address 127.15.157.190:34573)
0929 06:42:29.386425 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:29.386427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:29.386555 (+ 128us) server_negotiation.cc:407] Connection header received
0929 06:42:29.386633 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:29.386634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:29.386650 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:29.386714 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:29.387351 (+ 637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:29.387351 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:29.387352 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:42:29.387356 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:29.387369 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:42:29.387374 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:29.387427 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:29.387511 (+ 84us) server_negotiation.cc:299] Negotiation successful
0929 06:42:29.387527 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:42:29.387843 5674 catalog_manager.cc:1347] Generated new cluster ID: b14cd7ee6cba4bcfb0e0aa14230246d9
I20260929 06:42:29.387893 5674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:29.395160 5674 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:29.395329 5674 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:29.398933 5674 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e0a60dae13344b494339aec4ce27246: Generated new TSK 0
I20260929 06:42:29.399099 5674 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:42:29.406515 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 5592
2026-09-29T06:42:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1287 ms)
[----------] 18 tests from AuthTokenIssuingTest (23580 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:29 dist-test-slave-ltw5 krb5kdc[5691](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:29 dist-test-slave-ltw5 krb5kdc[5691](info): set up 2 sockets
Sep 29 06:42:29 dist-test-slave-ltw5 krb5kdc[5691](info): commencing operation
krb5kdc: starting...
W20260929 06:42:30.426366 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.002s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:30 dist-test-slave-ltw5 krb5kdc[5691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:42:30.549163 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:44563
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:44469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:44563,127.15.157.189:45301,127.15.157.188:45979
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:30.628146 5704 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 06:42:30.628350 5704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:30.628366 5704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:30.628386 5704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:30.629562 5704 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:30.629604 5704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:30.629618 5704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:30.629631 5704 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:30.629643 5704 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:30.631162 5704 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:44469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:44563,127.15.157.189:45301,127.15.157.188:45979
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:44563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:30.631413 5704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:30.631664 5704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:30.636471 5712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:30.636466 5709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:30.636449 5710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:30.636725 5704 server_base.cc:1034] running on GCE node
I20260929 06:42:30.636956 5704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:30.637240 5704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:30.638402 5704 hybrid_clock.cc:648] HybridClock initialized: now 1790664150638387 us; error 28 us; skew 500 ppm
Sep 29 06:42:30 dist-test-slave-ltw5 krb5kdc[5691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:30.646759 5704 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:42:30.647249 5704 webserver.cc:460] Webserver started at http://127.15.157.190:41493/ using document root <none> and password file <none>
I20260929 06:42:30.647490 5704 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:30.647565 5704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:30.647711 5704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:30.648782 5704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "69046f67169f4f24a43fd9a752cc209a"
format_stamp: "Formatted at 2026-09-29 06:42:30 on dist-test-slave-ltw5"
server_key: "6f3b06c1a919b783dd5d676330eba1ca"
server_key_iv: "c44edbaab0c1dc538abfa4d5acfdd069"
server_key_version: "encryptionkey@0"
I20260929 06:42:30.649135 5704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "69046f67169f4f24a43fd9a752cc209a"
format_stamp: "Formatted at 2026-09-29 06:42:30 on dist-test-slave-ltw5"
server_key: "6f3b06c1a919b783dd5d676330eba1ca"
server_key_iv: "c44edbaab0c1dc538abfa4d5acfdd069"
server_key_version: "encryptionkey@0"
I20260929 06:42:30.650530 5704 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:42:30.651273 5719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:30.651455 5704 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:42:30.651553 5704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "69046f67169f4f24a43fd9a752cc209a"
format_stamp: "Formatted at 2026-09-29 06:42:30 on dist-test-slave-ltw5"
server_key: "6f3b06c1a919b783dd5d676330eba1ca"
server_key_iv: "c44edbaab0c1dc538abfa4d5acfdd069"
server_key_version: "encryptionkey@0"
I20260929 06:42:30.651633 5704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:30.659916 5704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:30.662222 5704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:30.662418 5704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:30.666481 5704 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:44563
I20260929 06:42:30.666508 5771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:44563 every 8 connection(s)
I20260929 06:42:30.666874 5704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:30.667737 5772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:30.669184 5772 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:42:30.673686 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 5704
I20260929 06:42:30.673820 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:30.674039 15990 external_mini_cluster.cc:1428] Setting key 45112ceb83339da9f7774d491ac18be0
Sep 29 06:42:30 dist-test-slave-ltw5 krb5kdc[5691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:30.679225 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.669796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:44563 (local address 127.0.0.1:48860)
0929 06:42:30.670045 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.670088 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:30.670606 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:30.670900 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:30.670902 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:30.671187 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:30.671333 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:30.671338 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.672356 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.672356 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:30.673016 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:30.673018 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.673572 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.673574 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:30.673640 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.674288 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:30.674296 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:30.675877 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:30.677754 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:30.677761 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:30.677763 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:30.677954 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:30.678217 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:30.678217 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:30.678218 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:30.678300 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:30.678647 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:30.678652 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:30.678710 (+ 58us) client_negotiation.cc:769] Sending connection context
0929 06:42:30.678817 (+ 107us) client_negotiation.cc:240] Negotiation successful
0929 06:42:30.679053 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":96,"thread_start_us":90,"threads_started":1}
I20260929 06:42:30.679229 5775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.669868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48860 (local address 127.15.157.190:44563)
0929 06:42:30.670043 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:30.670054 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:30.670196 (+ 142us) server_negotiation.cc:407] Connection header received
0929 06:42:30.670772 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:30.670774 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:30.670790 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:30.670883 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:30.671441 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.672247 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.673121 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.673419 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.673601 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.675969 (+ 2368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:30.675977 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:30.675977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:30.675985 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:30.677656 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.678048 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.678051 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.678052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.678140 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.678363 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.678365 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.678365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.678575 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:30.678669 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:30.678849 (+ 180us) server_negotiation.cc:299] Negotiation successful
0929 06:42:30.678985 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
I20260929 06:42:30.680075 5772 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:42:30.680421 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.680306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45301 (local address 127.0.0.1:46956)
0929 06:42:30.680353 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.680397 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:45301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260929 06:42:30.680552 5722 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.157.189:45301: connect: Connection refused (error 111)
I20260929 06:42:30.680958 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.680869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45301 (local address 127.0.0.1:46964)
0929 06:42:30.680915 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.680938 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:45301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 06:42:30.681077 5772 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.189:45301: Network error: Client connection negotiation failed: client connection to 127.15.157.189:45301: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.15.157.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.189.keytab.
Entry for principal kudu/127.15.157.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.189.keytab.
I20260929 06:42:30.700336 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.189:45301
--webserver_interface=127.15.157.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.189.keytab
--principal=kudu/127.15.157.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:44469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:44563,127.15.157.189:45301,127.15.157.188:45979
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:42:30.730300 5772 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } attempt: 1
I20260929 06:42:30.730867 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.730705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45301 (local address 127.0.0.1:46976)
0929 06:42:30.730782 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.730830 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:45301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260929 06:42:30.731251 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.731152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45301 (local address 127.0.0.1:46990)
0929 06:42:30.731200 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.731229 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:45301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 06:42:30.731387 5772 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.189:45301: Network error: Client connection negotiation failed: client connection to 127.15.157.189:45301: connect: Connection refused (error 111)
W20260929 06:42:30.780891 5779 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 06:42:30.781097 5779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:30.781114 5779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:30.781134 5779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:30.782418 5779 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:30.782459 5779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:30.782472 5779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:30.782485 5779 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:30.782497 5779 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:30.783933 5779 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:44469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:44563,127.15.157.189:45301,127.15.157.188:45979
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.189.keytab
--principal=kudu/127.15.157.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.189:45301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.157.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:30.784186 5779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:30.784400 5779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:42:30.789258 5779 server_base.cc:1034] running on GCE node
W20260929 06:42:30.789180 5785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:30.789242 5784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:30.789181 5787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:30.789757 5779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:30.790093 5779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:30.791286 5779 hybrid_clock.cc:648] HybridClock initialized: now 1790664150791260 us; error 37 us; skew 500 ppm
Sep 29 06:42:30 dist-test-slave-ltw5 krb5kdc[5691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:30.793747 5779 init.cc:377] Logged in from keytab as kudu/127.15.157.189@KRBTEST.COM (short username kudu)
I20260929 06:42:30.794206 5779 webserver.cc:460] Webserver started at http://127.15.157.189:45109/ using document root <none> and password file <none>
I20260929 06:42:30.794385 5779 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:30.794425 5779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:30.794512 5779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:30.795639 5779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/data/instance:
uuid: "e7b87c4c5f39419492cffe3565feea5f"
format_stamp: "Formatted at 2026-09-29 06:42:30 on dist-test-slave-ltw5"
server_key: "9800bd27787b98edbe6fd50119c2c582"
server_key_iv: "5da48ddeaed2c32a90c3a76d411afff2"
server_key_version: "encryptionkey@0"
I20260929 06:42:30.796171 5779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/wal/instance:
uuid: "e7b87c4c5f39419492cffe3565feea5f"
format_stamp: "Formatted at 2026-09-29 06:42:30 on dist-test-slave-ltw5"
server_key: "9800bd27787b98edbe6fd50119c2c582"
server_key_iv: "5da48ddeaed2c32a90c3a76d411afff2"
server_key_version: "encryptionkey@0"
I20260929 06:42:30.797467 5779 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:42:30.798188 5794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:30.798337 5779 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:42:30.798424 5779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/wal
uuid: "e7b87c4c5f39419492cffe3565feea5f"
format_stamp: "Formatted at 2026-09-29 06:42:30 on dist-test-slave-ltw5"
server_key: "9800bd27787b98edbe6fd50119c2c582"
server_key_iv: "5da48ddeaed2c32a90c3a76d411afff2"
server_key_version: "encryptionkey@0"
I20260929 06:42:30.798477 5779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:30.799559 5772 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } attempt: 2
I20260929 06:42:30.799974 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.799827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45301 (local address 127.0.0.1:46992)
0929 06:42:30.799889 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.799931 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:45301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 06:42:30.800307 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.800210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45301 (local address 127.0.0.1:47002)
0929 06:42:30.800255 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.800282 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:45301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260929 06:42:30.800406 5772 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.189:45301: Network error: Client connection negotiation failed: client connection to 127.15.157.189:45301: connect: Connection refused (error 111)
I20260929 06:42:30.812548 5779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:30.814483 5779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:30.814597 5779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:30.818322 5779 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.189:45301
I20260929 06:42:30.818455 5846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.189:45301 every 8 connection(s)
I20260929 06:42:30.818732 5779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/data/info.pb
I20260929 06:42:30.819612 5847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:30.821123 5847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:42:30.825115 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 5779
I20260929 06:42:30.825253 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-1/wal/instance
I20260929 06:42:30.825438 15990 external_mini_cluster.cc:1428] Setting key b22a970d5251b2c79445ff2b33e8efa8
Sep 29 06:42:30 dist-test-slave-ltw5 krb5kdc[5691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.189@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:30.830781 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.821832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:44563 (local address 127.0.0.1:48862)
0929 06:42:30.822083 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.822119 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:30.822597 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:30.822856 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:30.822863 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:30.823102 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:30.823285 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:30.823288 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.823960 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.823961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:30.824769 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:30.824771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.825205 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.825206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:30.825363 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.825964 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:30.825979 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:30.827530 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:30.829417 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:30.829423 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:30.829424 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:30.829654 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:30.829872 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:30.829873 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:30.829873 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:30.829965 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:30.830300 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:30.830305 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:30.830419 (+ 114us) client_negotiation.cc:769] Sending connection context
0929 06:42:30.830506 (+ 87us) client_negotiation.cc:240] Negotiation successful
0929 06:42:30.830623 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":98,"threads_started":1}
I20260929 06:42:30.830793 5775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.821847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48862 (local address 127.15.157.190:44563)
0929 06:42:30.821915 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:30.821918 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:30.822200 (+ 282us) server_negotiation.cc:407] Connection header received
0929 06:42:30.822707 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:30.822709 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:30.822719 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:30.822781 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:30.823375 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.823885 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.824865 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.825080 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.825193 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.827632 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:30.827633 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:30.827633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:30.827642 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:30.829310 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.829731 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.829733 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.829733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.829802 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.830056 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.830057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.830057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.830225 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:30.830305 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:30.830556 (+ 251us) server_negotiation.cc:299] Negotiation successful
0929 06:42:30.830653 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 06:42:30.831472 5847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.15.157.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.188@KRBTEST.COM" created.
Sep 29 06:42:30 dist-test-slave-ltw5 krb5kdc[5691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.189@KRBTEST.COM for kudu/127.15.157.189@KRBTEST.COM
I20260929 06:42:30.839843 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.831767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45301 (local address 127.0.0.1:47012)
0929 06:42:30.831831 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.831840 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:30.831883 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:30.832156 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:30.832157 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:30.832298 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:30.832346 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:30.832348 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.833201 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.833202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:30.833781 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:30.833783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.834318 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.834319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:30.834381 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.834776 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:30.834780 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:30.837016 (+ 2236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:30.838818 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:30.838819 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:30.838819 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:30.838975 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:30.839195 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:30.839196 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:30.839196 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:30.839249 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:30.839531 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:30.839531 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:30.839569 (+ 38us) client_negotiation.cc:769] Sending connection context
0929 06:42:30.839631 (+ 62us) client_negotiation.cc:240] Negotiation successful
0929 06:42:30.839726 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260929 06:42:30.839911 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.831846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47012 (local address 127.15.157.189:45301)
0929 06:42:30.832025 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:30.832029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:30.832045 (+ 16us) server_negotiation.cc:407] Connection header received
0929 06:42:30.832062 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:30.832063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:30.832074 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:30.832156 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:30.832428 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.833113 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.833873 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.834229 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.834318 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.837124 (+ 2806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:30.837132 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:30.837133 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:30.837139 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:30.838694 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.839072 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.839075 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.839075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.839129 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.839316 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.839317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.839317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.839455 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:30.839547 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:30.839658 (+ 111us) server_negotiation.cc:299] Negotiation successful
0929 06:42:30.839777 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":149,"thread_start_us":102,"threads_started":1}
I20260929 06:42:30.840762 5847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:42:30.841150 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.841002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:45979 (local address 127.0.0.1:34846)
0929 06:42:30.841060 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.841115 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260929 06:42:30.841303 5798 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
I20260929 06:42:30.841768 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.841644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:45979 (local address 127.0.0.1:34852)
0929 06:42:30.841705 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.841739 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260929 06:42:30.841885 5847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:45979: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.188.keytab.
Entry for principal kudu/127.15.157.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.188.keytab.
I20260929 06:42:30.853021 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.188:45979
--webserver_interface=127.15.157.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.188.keytab
--principal=kudu/127.15.157.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:44469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:44563,127.15.157.189:45301,127.15.157.188:45979
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:42:30.891115 5847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } attempt: 1
I20260929 06:42:30.891538 5772 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } attempt: 3
I20260929 06:42:30.891676 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.891513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:45979 (local address 127.0.0.1:34864)
0929 06:42:30.891578 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.891618 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260929 06:42:30.892082 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.891989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:45979 (local address 127.0.0.1:34870)
0929 06:42:30.892026 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.892053 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260929 06:42:30.892174 5847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:45979: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
Sep 29 06:42:30 dist-test-slave-ltw5 krb5kdc[5691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for kudu/127.15.157.189@KRBTEST.COM
I20260929 06:42:30.898969 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.891817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45301 (local address 127.0.0.1:47014)
0929 06:42:30.891876 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.891888 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:30.891948 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:30.892111 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:30.892112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:30.892275 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:30.892345 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:30.892347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.893265 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.893266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:30.893813 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:30.893815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.894315 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.894316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:30.894375 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.894867 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:30.894872 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:30.896275 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:30.898076 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:30.898077 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:30.898078 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:30.898242 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:30.898440 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:30.898441 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:30.898441 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:30.898490 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:30.898747 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:30.898747 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:30.898784 (+ 37us) client_negotiation.cc:769] Sending connection context
0929 06:42:30.898836 (+ 52us) client_negotiation.cc:240] Negotiation successful
0929 06:42:30.898906 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 06:42:30.899085 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.891895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47014 (local address 127.15.157.189:45301)
0929 06:42:30.891936 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:30.891938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:30.891949 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:42:30.892022 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:30.892023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:30.892036 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:30.892091 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:30.892419 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.893182 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.893891 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.894235 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.894300 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.896361 (+ 2061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:30.896363 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:30.896363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:30.896371 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:30.897953 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.898312 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.898313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.898313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.898374 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.898547 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.898548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.898548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.898686 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:30.898751 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:30.898877 (+ 126us) server_negotiation.cc:299] Negotiation successful
0929 06:42:30.898964 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:42:30.899451 5772 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:42:30.899775 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.899675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:45979 (local address 127.0.0.1:34882)
0929 06:42:30.899718 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.899751 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260929 06:42:30.900074 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.900019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:45979 (local address 127.0.0.1:34892)
0929 06:42:30.900040 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.900060 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260929 06:42:30.900174 5772 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:45979: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
I20260929 06:42:30.931367 5772 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } attempt: 1
I20260929 06:42:30.931926 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.931758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:45979 (local address 127.0.0.1:34896)
0929 06:42:30.931847 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.931893 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260929 06:42:30.932394 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.932267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:45979 (local address 127.0.0.1:34898)
0929 06:42:30.932338 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.932369 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260929 06:42:30.932576 5772 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:45979: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
W20260929 06:42:30.936581 5854 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 06:42:30.936769 5854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:30.936784 5854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:30.936805 5854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:30.937904 5854 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:30.937943 5854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:30.937958 5854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:30.937970 5854 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:30.937983 5854 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:30.939451 5854 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:44469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:44563,127.15.157.189:45301,127.15.157.188:45979
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.188.keytab
--principal=kudu/127.15.157.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.188:45979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.157.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:30.939638 5854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:30.939800 5854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:30.944583 5859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:30.944583 5860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:30.944862 5854 server_base.cc:1034] running on GCE node
W20260929 06:42:30.944577 5862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:30.945257 5854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:30.945581 5854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:30.946758 5854 hybrid_clock.cc:648] HybridClock initialized: now 1790664150946737 us; error 35 us; skew 500 ppm
Sep 29 06:42:30 dist-test-slave-ltw5 krb5kdc[5691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:30.949599 5854 init.cc:377] Logged in from keytab as kudu/127.15.157.188@KRBTEST.COM (short username kudu)
I20260929 06:42:30.950073 5854 webserver.cc:460] Webserver started at http://127.15.157.188:42581/ using document root <none> and password file <none>
I20260929 06:42:30.950304 5854 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:30.950350 5854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:30.950489 5854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:30.951601 5854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/data/instance:
uuid: "d19efe2193f44614987cc954fc1aa957"
format_stamp: "Formatted at 2026-09-29 06:42:30 on dist-test-slave-ltw5"
server_key: "9b8bb9bdbe6f99aa65d23151b66c8b3f"
server_key_iv: "4a31e5ea1ee574c5cd77e6c60784b546"
server_key_version: "encryptionkey@0"
I20260929 06:42:30.951975 5854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/wal/instance:
uuid: "d19efe2193f44614987cc954fc1aa957"
format_stamp: "Formatted at 2026-09-29 06:42:30 on dist-test-slave-ltw5"
server_key: "9b8bb9bdbe6f99aa65d23151b66c8b3f"
server_key_iv: "4a31e5ea1ee574c5cd77e6c60784b546"
server_key_version: "encryptionkey@0"
I20260929 06:42:30.953349 5854 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:42:30.954298 5869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:30.954447 5854 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:30.954538 5854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/wal
uuid: "d19efe2193f44614987cc954fc1aa957"
format_stamp: "Formatted at 2026-09-29 06:42:30 on dist-test-slave-ltw5"
server_key: "9b8bb9bdbe6f99aa65d23151b66c8b3f"
server_key_iv: "4a31e5ea1ee574c5cd77e6c60784b546"
server_key_version: "encryptionkey@0"
I20260929 06:42:30.954630 5854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:30.960325 5847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } attempt: 2
I20260929 06:42:30.960711 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.960582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:45979 (local address 127.0.0.1:34908)
0929 06:42:30.960644 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.960674 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260929 06:42:30.961035 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.960934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:45979 (local address 127.0.0.1:34912)
0929 06:42:30.960978 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.961003 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260929 06:42:30.961122 5847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:45979: Network error: Client connection negotiation failed: client connection to 127.15.157.188:45979: connect: Connection refused (error 111)
I20260929 06:42:30.966347 5854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:30.968147 5854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:30.968298 5854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:30.972149 5854 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.188:45979
I20260929 06:42:30.972182 5921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.188:45979 every 8 connection(s)
I20260929 06:42:30.972699 5854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/data/info.pb
I20260929 06:42:30.973443 5922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:30.975080 5922 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:42:30.977965 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 5854
I20260929 06:42:30.978120 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663890058284-15990-0/minicluster-data/master-2/wal/instance
I20260929 06:42:30.978353 15990 external_mini_cluster.cc:1428] Setting key b1a193979445b3804ff81b7b9c46a115
Sep 29 06:42:30 dist-test-slave-ltw5 krb5kdc[5691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.188@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
Sep 29 06:42:30 dist-test-slave-ltw5 krb5kdc[5691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.188@KRBTEST.COM
I20260929 06:42:30.984802 5775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.975777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48876 (local address 127.15.157.190:44563)
0929 06:42:30.975864 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:30.975867 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:30.976035 (+ 168us) server_negotiation.cc:407] Connection header received
0929 06:42:30.976576 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:30.976577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:30.976590 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:30.976669 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:30.977270 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.977752 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.979019 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.979286 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.979340 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.981579 (+ 2239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:30.981580 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:30.981580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:30.981586 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:30.983247 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.983741 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.983742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.983742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.983790 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.984061 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.984062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.984062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.984194 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:30.984260 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:30.984603 (+ 343us) server_negotiation.cc:299] Negotiation successful
0929 06:42:30.984686 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:42:30.985231 5924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.975769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:44563 (local address 127.0.0.1:48876)
0929 06:42:30.975921 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.975954 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:30.976440 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:30.976749 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:30.976752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:30.976994 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:30.977180 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:30.977185 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.977844 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.977844 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:30.978936 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:30.978939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.979363 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.979364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:30.979517 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.980089 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:30.980097 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:30.981480 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:30.983328 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:30.983333 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:30.983335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:30.983664 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:30.983856 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:30.983857 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:30.983858 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:30.983986 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:30.984266 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:30.984272 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:30.984433 (+ 161us) client_negotiation.cc:769] Sending connection context
0929 06:42:30.984568 (+ 135us) client_negotiation.cc:240] Negotiation successful
0929 06:42:30.984724 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":61,"threads_started":1}
I20260929 06:42:30.985802 5922 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:42:30.987607 5926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.978778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34914 (local address 127.15.157.188:45979)
0929 06:42:30.978946 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:30.978950 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:30.979011 (+ 61us) server_negotiation.cc:407] Connection header received
0929 06:42:30.979048 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:30.979050 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:30.979070 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:30.979150 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:30.979869 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.980673 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.981417 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.981823 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.981891 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.984608 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:30.984615 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:30.984616 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:30.984622 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:30.986519 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.986893 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.986895 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.986896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.986957 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.987126 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.987127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.987127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.987275 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:30.987422 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:30.987468 (+ 46us) server_negotiation.cc:299] Negotiation successful
0929 06:42:30.987545 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":74,"threads_started":1}
Sep 29 06:42:30 dist-test-slave-ltw5 krb5kdc[5691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.188@KRBTEST.COM for kudu/127.15.157.189@KRBTEST.COM
I20260929 06:42:30.993081 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.986181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47030 (local address 127.15.157.189:45301)
0929 06:42:30.986225 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:30.986227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:30.986262 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:42:30.986337 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:30.986338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:30.986348 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:30.986401 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:30.986697 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.987370 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.988258 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.988526 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.988614 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.990471 (+ 1857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:30.990472 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:30.990473 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:30.990479 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:30.992080 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.992394 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.992395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.992396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.992457 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.992648 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.992649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.992650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.992775 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:30.992841 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:30.992946 (+ 105us) server_negotiation.cc:299] Negotiation successful
0929 06:42:30.993017 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:42:30.993125 5924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.986113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:45301 (local address 127.0.0.1:47030)
0929 06:42:30.986220 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.986231 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:30.986276 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:30.986405 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:30.986405 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:30.986575 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:30.986627 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:30.986629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.987447 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.987447 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:30.988178 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:30.988181 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.988614 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.988615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:30.988672 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.988967 (+ 295us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:30.988970 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:30.990394 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:30.992159 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:30.992160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:30.992160 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:30.992314 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:30.992528 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:30.992529 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:30.992529 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:30.992581 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:30.992835 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:30.992836 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:30.992866 (+ 30us) client_negotiation.cc:769] Sending connection context
0929 06:42:30.992914 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 06:42:30.993013 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
Sep 29 06:42:30 dist-test-slave-ltw5 krb5kdc[5691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:30.993600 5922 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:42:30.996933 5775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.988371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48882 (local address 127.15.157.190:44563)
0929 06:42:30.988415 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:30.988416 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:30.988728 (+ 312us) server_negotiation.cc:407] Connection header received
0929 06:42:30.988968 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:30.988968 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:30.988977 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:30.989022 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:30.989646 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.990384 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.991240 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.991490 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.991546 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.994045 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:30.994046 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:30.994047 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:30.994054 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:30.995675 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.996030 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.996030 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.996030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.996081 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:30.996273 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:30.996273 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:30.996274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:30.996438 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:30.996641 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:30.996746 (+ 105us) server_negotiation.cc:299] Negotiation successful
0929 06:42:30.996830 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Sep 29 06:42:30 dist-test-slave-ltw5 krb5kdc[5691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.188@KRBTEST.COM for kudu/127.15.157.188@KRBTEST.COM
I20260929 06:42:31.001055 5926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.993988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34920 (local address 127.15.157.188:45979)
0929 06:42:30.994070 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:30.994072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:30.994091 (+ 19us) server_negotiation.cc:407] Connection header received
0929 06:42:30.994108 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:30.994109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:30.994119 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:30.994179 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:30.994487 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.995089 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.995978 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.996330 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.996385 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.998315 (+ 1930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:30.998316 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:30.998316 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:30.998322 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:30.999798 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:31.000216 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:31.000217 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:31.000217 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:31.000266 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:31.000465 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:31.000466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:31.000466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:31.000589 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:31.000660 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:31.000856 (+ 196us) server_negotiation.cc:299] Negotiation successful
0929 06:42:31.000982 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":64}
I20260929 06:42:31.001111 5924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.993914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:45979 (local address 127.0.0.1:34920)
0929 06:42:30.993977 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:30.993988 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:30.994047 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:30.994189 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:30.994190 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:30.994336 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:30.994369 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:30.994373 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.995178 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.995180 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:30.995907 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:30.995909 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.996418 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.996419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:30.996481 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:30.996903 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:30.996908 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:30.998229 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:30.999900 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:30.999901 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:30.999901 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:31.000141 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:31.000331 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:31.000332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:31.000333 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:31.000399 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:31.000654 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:31.000656 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:31.000747 (+ 91us) client_negotiation.cc:769] Sending connection context
0929 06:42:31.000838 (+ 91us) client_negotiation.cc:240] Negotiation successful
0929 06:42:31.000940 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
Sep 29 06:42:30 dist-test-slave-ltw5 krb5kdc[5691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.189@KRBTEST.COM
I20260929 06:42:31.002740 5922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957: Bootstrap starting.
I20260929 06:42:31.003683 5922 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:31.004061 5922 log.cc:824] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:31.004860 5922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957: No bootstrap required, opened a new log
I20260929 06:42:31.005051 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:30.997557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47036 (local address 127.15.157.189:45301)
0929 06:42:30.997615 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:30.997618 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:30.997624 (+ 6us) server_negotiation.cc:407] Connection header received
0929 06:42:30.997645 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:30.997646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:30.997654 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:30.997698 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:30.998264 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.998706 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.999351 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:30.999570 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:30.999655 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:31.002203 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:31.002204 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:31.002205 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:31.002211 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:31.003844 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:31.004238 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:31.004239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:31.004240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:31.004304 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:31.004535 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:31.004536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:31.004536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:31.004650 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:31.004845 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:31.004882 (+ 37us) server_negotiation.cc:299] Negotiation successful
0929 06:42:31.004956 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 06:42:31.006589 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:31.007128 5922 raft_consensus.cc:348] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } }
I20260929 06:42:31.007282 5922 raft_consensus.cc:729] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19efe2193f44614987cc954fc1aa957, State: Initialized, Role: FOLLOWER
I20260929 06:42:31.007383 5922 consensus_queue.cc:260] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } }
I20260929 06:42:31.007768 5922 sys_catalog.cc:564] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:31.007757 5928 sys_catalog.cc:455] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } } }
I20260929 06:42:31.007870 5928 sys_catalog.cc:458] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:42:31.007782 5746 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "69046f67169f4f24a43fd9a752cc209a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48882
I20260929 06:42:31.008644 5772 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } attempt: 2
W20260929 06:42:31.010120 5939 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:42:31.010167 5939 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:42:31.010076 5854 master_runner.cc:186] Error getting master registration for 127.15.157.190:44563: OK, instance_id { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" instance_seqno: 1790664150665250 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 06:42:31.012955 5854 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Sep 29 06:42:31 dist-test-slave-ltw5 krb5kdc[5691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for kudu/127.15.157.188@KRBTEST.COM
I20260929 06:42:31.016705 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:31.008909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:45979 (local address 127.0.0.1:34936)
0929 06:42:31.008946 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:31.008957 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:31.008996 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:31.009202 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:31.009203 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:31.009374 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:31.009418 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:31.009421 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:31.010347 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:31.010348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:31.011115 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:31.011119 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:31.011639 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:31.011640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:31.011695 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:31.012155 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:31.012160 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:31.013632 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:31.015561 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:31.015562 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:31.015563 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:31.015787 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:31.016000 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:31.016001 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:31.016002 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:31.016062 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:31.016379 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:31.016380 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:31.016427 (+ 47us) client_negotiation.cc:769] Sending connection context
0929 06:42:31.016493 (+ 66us) client_negotiation.cc:240] Negotiation successful
0929 06:42:31.016599 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260929 06:42:31.016710 5926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:31.008988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34936 (local address 127.15.157.188:45979)
0929 06:42:31.009078 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.009079 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.009087 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:42:31.009106 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.009107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.009117 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.009163 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.009497 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:31.010261 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:31.011227 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:31.011513 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:31.011581 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:31.013727 (+ 2146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:31.013729 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:31.013729 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:31.013736 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:31.015450 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:31.015862 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:31.015863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:31.015863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:31.015926 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:31.016126 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:31.016127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:31.016127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:31.016308 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:31.016383 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:31.016533 (+ 150us) server_negotiation.cc:299] Negotiation successful
0929 06:42:31.016623 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260929 06:42:31.018534 5772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a: Bootstrap starting.
I20260929 06:42:31.019259 5772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:31.019578 5772 log.cc:824] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:31.020388 5772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a: No bootstrap required, opened a new log
I20260929 06:42:31.021764 5772 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } }
I20260929 06:42:31.021911 5772 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69046f67169f4f24a43fd9a752cc209a, State: Initialized, Role: FOLLOWER
I20260929 06:42:31.021999 5772 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } }
I20260929 06:42:31.022395 5772 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:31.022406 5746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 06:42:31.022511 5746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:31.023392 5746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } }
I20260929 06:42:31.023667 5746 leader_election.cc:288] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [CANDIDATE]: Term 1 election: Requested vote from peers e7b87c4c5f39419492cffe3565feea5f (127.15.157.189:45301), d19efe2193f44614987cc954fc1aa957 (127.15.157.188:45979)
I20260929 06:42:31.024389 5896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "69046f67169f4f24a43fd9a752cc209a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d19efe2193f44614987cc954fc1aa957"
I20260929 06:42:31.024526 5896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:31.025558 5896 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69046f67169f4f24a43fd9a752cc209a in term 1.
W20260929 06:42:31.024315 5953 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:42:31.027043 5953 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:42:31.027400 5723 leader_election.cc:302] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69046f67169f4f24a43fd9a752cc209a, d19efe2193f44614987cc954fc1aa957; no voters:
I20260929 06:42:31.028399 5704 master_runner.cc:186] Error getting master registration for 127.15.157.189:45301: OK, instance_id { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" instance_seqno: 1790664150817198 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 06:42:31.030797 5704 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 06:42:31.022362 5942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } } }
I20260929 06:42:31.031111 5942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:42:31.031256 5942 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:31.031401 5942 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [term 1 LEADER]: Becoming Leader. State: Replica: 69046f67169f4f24a43fd9a752cc209a, State: Running, Role: LEADER
I20260929 06:42:31.031610 5942 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } }
I20260929 06:42:31.032485 5942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69046f67169f4f24a43fd9a752cc209a. Latest consensus state: current_term: 1 leader_uuid: "69046f67169f4f24a43fd9a752cc209a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } } }
I20260929 06:42:31.032703 5942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:31.033274 5964 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:31.034607 5964 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:31.041903 5775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:31.027127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48894 (local address 127.15.157.190:44563)
0929 06:42:31.027169 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.027171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.027907 (+ 736us) server_negotiation.cc:407] Connection header received
0929 06:42:31.028008 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.028009 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.028032 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.028063 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.028856 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:31.029623 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:31.032623 (+ 3000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:31.032938 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:31.032979 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:31.038203 (+ 5224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:31.038205 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:31.038205 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:31.038213 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:31.040163 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:31.040833 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:31.040835 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:31.040835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:31.040904 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:31.041203 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:31.041204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:31.041204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:31.041340 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:31.041421 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:31.041729 (+ 308us) server_negotiation.cc:299] Negotiation successful
0929 06:42:31.041811 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:42:31.045935 5926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:31.027649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34942 (local address 127.15.157.188:45979)
0929 06:42:31.027683 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.027685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.031769 (+ 4084us) server_negotiation.cc:407] Connection header received
0929 06:42:31.031871 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.031872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.031884 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.031913 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.035185 (+ 3272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:31.035886 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:31.038263 (+ 2377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:31.038795 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:31.038837 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:31.042116 (+ 3279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:31.042117 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:31.042117 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:31.042127 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:31.044294 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:31.044859 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:31.044861 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:31.044861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:31.044918 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:31.045240 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:31.045241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:31.045242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:31.045383 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:31.045472 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:31.045760 (+ 288us) server_negotiation.cc:299] Negotiation successful
0929 06:42:31.045838 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:42:31.046963 5896 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957 [term 1 FOLLOWER]: Refusing update from remote peer 69046f67169f4f24a43fd9a752cc209a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:42:31.047386 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:31.027332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47044 (local address 127.15.157.189:45301)
0929 06:42:31.027372 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.027374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.030829 (+ 3455us) server_negotiation.cc:407] Connection header received
0929 06:42:31.030929 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.030930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.030941 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.030970 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.033347 (+ 2377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:31.034150 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:31.036886 (+ 2736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:31.037655 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:31.037713 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:31.043379 (+ 5666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:31.043380 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:31.043380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:31.043388 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:31.045595 (+ 2207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:31.045985 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:31.045986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:31.045987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:31.046078 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:31.046336 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:31.046337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:31.046337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:31.046460 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:31.046525 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:31.047204 (+ 679us) server_negotiation.cc:299] Negotiation successful
0929 06:42:31.047292 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:42:31.047358 5961 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:42:31.048810 5928 sys_catalog.cc:455] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69046f67169f4f24a43fd9a752cc209a. Latest consensus state: current_term: 1 leader_uuid: "69046f67169f4f24a43fd9a752cc209a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } } }
I20260929 06:42:31.048913 5928 sys_catalog.cc:458] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:42:31.050194 5942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "69046f67169f4f24a43fd9a752cc209a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } } }
I20260929 06:42:31.050279 5942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:31.051008 5928 sys_catalog.cc:455] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "69046f67169f4f24a43fd9a752cc209a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } } }
I20260929 06:42:31.051105 5928 sys_catalog.cc:458] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:42:31.051272 5966 mvcc.cc:205] Tried to move back new op lower bound from 7334560362685775872 to 7334560362627461120. Current Snapshot: MvccSnapshot[applied={T|T < 7334560362685775872}]
I20260929 06:42:31.052263 5847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } attempt: 3
I20260929 06:42:31.057361 5964 catalog_manager.cc:1347] Generated new cluster ID: ddfc2b9f6f2845d18b27c9232705f038
I20260929 06:42:31.057416 5964 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:42:31 dist-test-slave-ltw5 krb5kdc[5691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664150, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.189@KRBTEST.COM for kudu/127.15.157.188@KRBTEST.COM
I20260929 06:42:31.061354 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:31.052497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:45979 (local address 127.0.0.1:34944)
0929 06:42:31.052543 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:31.052553 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:31.052589 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:31.052747 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:31.052748 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:31.052907 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:31.052948 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:31.052950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:31.053900 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:31.053902 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:31.054775 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:31.054777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:31.055282 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:31.055283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:31.055343 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:31.056767 (+ 1424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:31.056773 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:31.058384 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:31.060266 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:31.060267 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:31.060268 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:31.060489 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:31.060715 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:31.060716 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:31.060716 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:31.060782 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:31.061057 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:31.061058 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:31.061112 (+ 54us) client_negotiation.cc:769] Sending connection context
0929 06:42:31.061170 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 06:42:31.061257 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260929 06:42:31.061379 5926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:31.052551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34944 (local address 127.15.157.188:45979)
0929 06:42:31.052592 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.052593 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.052602 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:42:31.052655 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.052656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.052667 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.052711 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.053006 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:31.053817 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:31.054872 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:31.055204 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:31.055276 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:31.058483 (+ 3207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:31.058484 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:31.058485 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:31.058491 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:31.060163 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:31.060565 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:31.060566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:31.060567 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:31.060629 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:31.060840 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:31.060840 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:31.060841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:31.060983 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:31.061058 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:31.061211 (+ 153us) server_negotiation.cc:299] Negotiation successful
0929 06:42:31.061289 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 06:42:31.063318 5847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f: Bootstrap starting.
I20260929 06:42:31.063994 5847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:31.064253 5847 log.cc:824] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:31.065214 5847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f: No bootstrap required, opened a new log
I20260929 06:42:31.067101 5847 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } }
I20260929 06:42:31.067222 5847 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7b87c4c5f39419492cffe3565feea5f, State: Initialized, Role: FOLLOWER
I20260929 06:42:31.067287 5847 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } }
I20260929 06:42:31.067575 5847 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:31.068738 5821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "69046f67169f4f24a43fd9a752cc209a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e7b87c4c5f39419492cffe3565feea5f"
I20260929 06:42:31.068831 5821 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:31.069572 5821 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69046f67169f4f24a43fd9a752cc209a in term 1.
I20260929 06:42:31.069922 5820 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f [term 1 FOLLOWER]: Refusing update from remote peer 69046f67169f4f24a43fd9a752cc209a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:42:31.070175 5961 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:42:31.071182 5971 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } } }
I20260929 06:42:31.071264 5971 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:42:31.073232 5983 mvcc.cc:205] Tried to move back new op lower bound from 7334560362685775872 to 7334560362627461120. Current Snapshot: MvccSnapshot[applied={T|T < 7334560362685775872}]
I20260929 06:42:31.073830 5971 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69046f67169f4f24a43fd9a752cc209a. Latest consensus state: current_term: 1 leader_uuid: "69046f67169f4f24a43fd9a752cc209a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } } }
I20260929 06:42:31.073901 5971 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:42:31.073927 5971 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "69046f67169f4f24a43fd9a752cc209a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } } }
I20260929 06:42:31.073958 5971 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:42:31.074636 5982 catalog_manager.cc:1259] Loaded cluster ID: ddfc2b9f6f2845d18b27c9232705f038
I20260929 06:42:31.074676 5982 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f: loading cluster ID for follower catalog manager: success
W20260929 06:42:31.074736 5982 catalog_manager.cc:1576] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260929 06:42:31.074765 5982 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:42:31.087416 5961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "69046f67169f4f24a43fd9a752cc209a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69046f67169f4f24a43fd9a752cc209a" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 44563 } } peers { permanent_uuid: "e7b87c4c5f39419492cffe3565feea5f" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 45301 } } peers { permanent_uuid: "d19efe2193f44614987cc954fc1aa957" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 45979 } } }
I20260929 06:42:31.087558 5961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:31.095160 5964 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:31.095978 5964 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:31.107115 5964 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69046f67169f4f24a43fd9a752cc209a: Generated new TSK 0
I20260929 06:42:31.107335 5964 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 06:42:31.127416 5926 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:31.126110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34954 (local address 127.15.157.188:45979)
0929 06:42:31.126155 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.126157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.126777 (+ 620us) server_negotiation.cc:407] Connection header received
0929 06:42:31.126882 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.126883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.126895 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.126925 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.127345 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34954: BlockingRecv error: recv got EOF from 127.0.0.1:34954 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260929 06:42:31.128207 5851 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:31.126493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47052 (local address 127.15.157.189:45301)
0929 06:42:31.126541 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.126543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.127720 (+ 1177us) server_negotiation.cc:407] Connection header received
0929 06:42:31.127815 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.127816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.127826 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.127854 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.128148 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47052: BlockingRecv error: recv got EOF from 127.0.0.1:47052 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260929 06:42:31.129323 5775 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:31.128637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48896 (local address 127.15.157.190:44563)
0929 06:42:31.128675 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.128676 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.128799 (+ 123us) server_negotiation.cc:407] Connection header received
0929 06:42:31.128890 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.128891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.128901 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.128931 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.129252 (+ 321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48896: BlockingRecv error: recv got EOF from 127.0.0.1:48896 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260929 06:42:31.131599 5851 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:31.130833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47062 (local address 127.15.157.189:45301)
0929 06:42:31.130865 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.130866 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.131062 (+ 196us) server_negotiation.cc:407] Connection header received
0929 06:42:31.131162 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.131163 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.131180 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.131209 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.131503 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47062: BlockingRecv error: recv got EOF from 127.0.0.1:47062 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 06:42:31.134588 5851 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:31.133758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47064 (local address 127.15.157.189:45301)
0929 06:42:31.133788 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.133790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.134071 (+ 281us) server_negotiation.cc:407] Connection header received
0929 06:42:31.134214 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.134215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.134224 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.134252 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.134547 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47064: BlockingRecv error: recv got EOF from 127.0.0.1:47064 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 06:42:31.138393 5851 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:31.137602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47068 (local address 127.15.157.189:45301)
0929 06:42:31.137640 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.137642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.137865 (+ 223us) server_negotiation.cc:407] Connection header received
0929 06:42:31.137955 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.137956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.137965 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.137993 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.138351 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47068: BlockingRecv error: recv got EOF from 127.0.0.1:47068 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260929 06:42:31.144236 5851 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:31.143485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47082 (local address 127.15.157.189:45301)
0929 06:42:31.143517 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.143519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.143761 (+ 242us) server_negotiation.cc:407] Connection header received
0929 06:42:31.143854 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.143855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.143866 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.143894 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.144192 (+ 298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47082: BlockingRecv error: recv got EOF from 127.0.0.1:47082 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260929 06:42:31.154330 5851 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:31.153362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47090 (local address 127.15.157.189:45301)
0929 06:42:31.153398 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.153400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.153715 (+ 315us) server_negotiation.cc:407] Connection header received
0929 06:42:31.153832 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.153833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.153844 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.153872 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.154277 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47090: BlockingRecv error: recv got EOF from 127.0.0.1:47090 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260929 06:42:31.172588 5851 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:31.171648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47104 (local address 127.15.157.189:45301)
0929 06:42:31.171691 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.171693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.171974 (+ 281us) server_negotiation.cc:407] Connection header received
0929 06:42:31.172081 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.172083 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.172095 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.172126 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.172518 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47104: BlockingRecv error: recv got EOF from 127.0.0.1:47104 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260929 06:42:31.207803 5851 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:31.206049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47110 (local address 127.15.157.189:45301)
0929 06:42:31.206098 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.206100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.206242 (+ 142us) server_negotiation.cc:407] Connection header received
0929 06:42:31.206300 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.206301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.206314 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.206396 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.207723 (+ 1327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47110: BlockingRecv error: recv got EOF from 127.0.0.1:47110 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260929 06:42:31.273325 5851 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:31.272487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47118 (local address 127.15.157.189:45301)
0929 06:42:31.272597 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.272600 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.272714 (+ 114us) server_negotiation.cc:407] Connection header received
0929 06:42:31.272794 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.272795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.272810 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.272884 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.273250 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47118: BlockingRecv error: recv got EOF from 127.0.0.1:47118 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260929 06:42:31.403671 5851 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:31.402798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47120 (local address 127.15.157.189:45301)
0929 06:42:31.402898 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.402900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.403032 (+ 132us) server_negotiation.cc:407] Connection header received
0929 06:42:31.403128 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.403131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.403147 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.403214 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.403585 (+ 371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47120: BlockingRecv error: recv got EOF from 127.0.0.1:47120 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260929 06:42:31.661844 5851 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:31.661160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47132 (local address 127.15.157.189:45301)
0929 06:42:31.661236 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:31.661238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:31.661247 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:42:31.661277 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:31.661278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:31.661290 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:31.661368 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:31.661754 (+ 386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47132: BlockingRecv error: recv got EOF from 127.0.0.1:47132 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260929 06:42:32.010591 5939 catalog_manager.cc:1259] Loaded cluster ID: ddfc2b9f6f2845d18b27c9232705f038
I20260929 06:42:32.010664 5939 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957: loading cluster ID for follower catalog manager: success
I20260929 06:42:32.011451 5939 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957: acquiring CA information for follower catalog manager: success
I20260929 06:42:32.011716 5939 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d19efe2193f44614987cc954fc1aa957: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:42:32.075868 5982 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f: acquiring CA information for follower catalog manager: success
I20260929 06:42:32.076179 5982 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e7b87c4c5f39419492cffe3565feea5f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:42:32.177791 6051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:32.175044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47144 (local address 127.15.157.189:45301)
0929 06:42:32.175183 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:32.175186 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:32.175273 (+ 87us) server_negotiation.cc:407] Connection header received
0929 06:42:32.175370 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:32.175371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:32.175431 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:32.175523 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:32.175651 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:32.176149 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:32.176940 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:32.177146 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:32.177233 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:32.177416 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:32.177529 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:32.177618 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:32.177669 (+ 51us) server_negotiation.cc:299] Negotiation successful
0929 06:42:32.177689 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":58,"threads_started":1}
I20260929 06:42:32.181649 6057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:32.179515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34958 (local address 127.15.157.188:45979)
0929 06:42:32.179610 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:32.179612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:32.179620 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:42:32.179659 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:32.179659 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:32.179692 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:32.179762 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:32.179863 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:32.180335 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:32.180997 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:32.181187 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:32.181234 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:32.181356 (+ 122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:32.181448 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:32.181501 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:32.181535 (+ 34us) server_negotiation.cc:299] Negotiation successful
0929 06:42:32.181552 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":52,"threads_started":1}
I20260929 06:42:32.186182 6051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:32.183125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47158 (local address 127.15.157.189:45301)
0929 06:42:32.183165 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:32.183167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:32.183435 (+ 268us) server_negotiation.cc:407] Connection header received
0929 06:42:32.183496 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:32.183497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:32.183509 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:32.183576 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:32.183752 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:32.184477 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:32.185418 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:32.185689 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:32.185752 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:32.185897 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:32.185929 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:32.185982 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:32.186088 (+ 106us) server_negotiation.cc:299] Negotiation successful
0929 06:42:32.186112 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:42:32.186443 6065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:32.183373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48908 (local address 127.15.157.190:44563)
0929 06:42:32.183555 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:32.183558 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:32.183565 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:42:32.183607 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:32.183608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:32.183661 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:32.183862 (+ 201us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:32.183891 (+ 29us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:32.184354 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:32.185472 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:32.185793 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:32.185874 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:32.186081 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:32.186182 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:32.186249 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:32.186315 (+ 66us) server_negotiation.cc:299] Negotiation successful
0929 06:42:32.186343 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":49,"threads_started":1}
I20260929 06:42:32.186786 6057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:32.183296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34966 (local address 127.15.157.188:45979)
0929 06:42:32.183356 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:32.183358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:32.183367 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:42:32.183392 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:32.183393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:32.183403 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:32.183455 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:32.183693 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:32.184401 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:32.185918 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:32.186226 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:32.186289 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:32.186463 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:32.186494 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:32.186542 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:32.186698 (+ 156us) server_negotiation.cc:299] Negotiation successful
0929 06:42:32.186724 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 06:42:32.188249 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 5704
I20260929 06:42:32.193502 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 5779
I20260929 06:42:32.198577 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 5854
2026-09-29T06:42:32Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2793 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:42:32 dist-test-slave-ltw5 krb5kdc[6068](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:42:32 dist-test-slave-ltw5 krb5kdc[6068](info): set up 2 sockets
Sep 29 06:42:32 dist-test-slave-ltw5 krb5kdc[6068](info): commencing operation
krb5kdc: starting...
W20260929 06:42:33.234409 15990 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/test-user.keytab.
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:42:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:42:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.157.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
Entry for principal kudu/127.15.157.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab.
I20260929 06:42:33.349331 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45379
--webserver_interface=127.15.157.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:36201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:45379,127.15.157.189:41355,127.15.157.188:44823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:42:33.429839 6081 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 06:42:33.430074 6081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:33.430092 6081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:33.430114 6081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:33.431222 6081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:33.431255 6081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:33.431269 6081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:33.431282 6081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:33.431294 6081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:33.432708 6081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:36201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:45379,127.15.157.189:41355,127.15.157.188:44823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.190.keytab
--principal=kudu/127.15.157.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.190:45379
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.157.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:33.432898 6081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:33.433060 6081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:33.437739 6086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:33.437754 6087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:33.437796 6089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:33.438002 6081 server_base.cc:1034] running on GCE node
I20260929 06:42:33.438337 6081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:33.438643 6081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:33.439836 6081 hybrid_clock.cc:648] HybridClock initialized: now 1790664153439811 us; error 35 us; skew 500 ppm
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:33.442307 6081 init.cc:377] Logged in from keytab as kudu/127.15.157.190@KRBTEST.COM (short username kudu)
I20260929 06:42:33.442773 6081 webserver.cc:460] Webserver started at http://127.15.157.190:32815/ using document root <none> and password file <none>
I20260929 06:42:33.443010 6081 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:33.443094 6081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:33.443244 6081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:33.444304 6081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/data/instance:
uuid: "1bb40818fda84856b05d531a44d8d7d9"
format_stamp: "Formatted at 2026-09-29 06:42:33 on dist-test-slave-ltw5"
server_key: "a722eca5a9fb96d93866e2d8769db9d1"
server_key_iv: "0b7998ee44aca6624a60ac23d3f5dbeb"
server_key_version: "encryptionkey@0"
I20260929 06:42:33.444670 6081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/wal/instance:
uuid: "1bb40818fda84856b05d531a44d8d7d9"
format_stamp: "Formatted at 2026-09-29 06:42:33 on dist-test-slave-ltw5"
server_key: "a722eca5a9fb96d93866e2d8769db9d1"
server_key_iv: "0b7998ee44aca6624a60ac23d3f5dbeb"
server_key_version: "encryptionkey@0"
I20260929 06:42:33.445959 6081 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:42:33.446729 6096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:33.446900 6081 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:42:33.447000 6081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/wal
uuid: "1bb40818fda84856b05d531a44d8d7d9"
format_stamp: "Formatted at 2026-09-29 06:42:33 on dist-test-slave-ltw5"
server_key: "a722eca5a9fb96d93866e2d8769db9d1"
server_key_iv: "0b7998ee44aca6624a60ac23d3f5dbeb"
server_key_version: "encryptionkey@0"
I20260929 06:42:33.447093 6081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:33.455281 6081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:33.457088 6081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:33.457248 6081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:33.461279 6081 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.190:45379
I20260929 06:42:33.461310 6148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.190:45379 every 8 connection(s)
I20260929 06:42:33.461658 6081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/data/info.pb
I20260929 06:42:33.462554 6149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:33.463557 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 6081
I20260929 06:42:33.463680 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-0/wal/instance
I20260929 06:42:33.463850 15990 external_mini_cluster.cc:1428] Setting key 8d08c68f83d1bcf3124cc8f25cb793fb
I20260929 06:42:33.464138 6149 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.157.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.189@KRBTEST.COM" created.
I20260929 06:42:33.473847 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.464845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45379 (local address 127.0.0.1:55074)
0929 06:42:33.465009 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.465053 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:33.465560 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:33.465856 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:33.465858 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:33.466190 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:33.466336 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.466341 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.467378 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.467379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.468042 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.468044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.468532 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.468532 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.468594 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.469122 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:33.469131 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:33.470491 (+ 1360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:33.472316 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.472322 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.472324 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.472513 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.472794 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.472795 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.472795 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.472882 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.473271 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:33.473276 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:33.473334 (+ 58us) client_negotiation.cc:769] Sending connection context
0929 06:42:33.473443 (+ 109us) client_negotiation.cc:240] Negotiation successful
0929 06:42:33.473689 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":98,"thread_start_us":77,"threads_started":1}
I20260929 06:42:33.473855 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.464870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55074 (local address 127.15.157.190:45379)
0929 06:42:33.465053 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.465062 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.465178 (+ 116us) server_negotiation.cc:407] Connection header received
0929 06:42:33.465735 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.465738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.465760 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.465853 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.466438 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.467268 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.468135 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.468437 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.468560 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.470593 (+ 2033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.470599 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.470599 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.470606 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.472216 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.472631 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.472633 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.472634 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.472728 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.472948 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.472950 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.472950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.473204 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.473290 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.473489 (+ 199us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.473609 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":87,"threads_started":1}
I20260929 06:42:33.474537 6149 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:42:33.474886 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.474770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:41355 (local address 127.0.0.1:54808)
0929 06:42:33.474817 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.474858 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:41355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 06:42:33.475004 6100 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.157.189:41355: connect: Connection refused (error 111)
I20260929 06:42:33.475383 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.475288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:41355 (local address 127.0.0.1:54820)
0929 06:42:33.475340 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.475363 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:41355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260929 06:42:33.475489 6149 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.189:41355: Network error: Client connection negotiation failed: client connection to 127.15.157.189:41355: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.189.keytab.
Entry for principal kudu/127.15.157.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.189.keytab.
I20260929 06:42:33.488457 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.189:41355
--webserver_interface=127.15.157.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.189.keytab
--principal=kudu/127.15.157.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:36201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:45379,127.15.157.189:41355,127.15.157.188:44823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:42:33.524816 6149 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } attempt: 1
I20260929 06:42:33.525350 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.525210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:41355 (local address 127.0.0.1:54830)
0929 06:42:33.525283 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.525323 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:41355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260929 06:42:33.525781 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.525692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:41355 (local address 127.0.0.1:54844)
0929 06:42:33.525739 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.525765 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:41355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 06:42:33.525899 6149 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.189:41355: Network error: Client connection negotiation failed: client connection to 127.15.157.189:41355: connect: Connection refused (error 111)
W20260929 06:42:33.568938 6156 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 06:42:33.569160 6156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:33.569177 6156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:33.569196 6156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:33.570374 6156 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:33.570410 6156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:33.570425 6156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:33.570437 6156 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:33.570449 6156 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:33.571859 6156 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:36201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:45379,127.15.157.189:41355,127.15.157.188:44823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.189.keytab
--principal=kudu/127.15.157.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.189:41355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.157.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:33.572043 6156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:33.572202 6156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:33.576972 6161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:33.577106 6164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:33.576954 6162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:33.577212 6156 server_base.cc:1034] running on GCE node
I20260929 06:42:33.577443 6156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:33.577680 6156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:33.578821 6156 hybrid_clock.cc:648] HybridClock initialized: now 1790664153578808 us; error 28 us; skew 500 ppm
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:33.581163 6156 init.cc:377] Logged in from keytab as kudu/127.15.157.189@KRBTEST.COM (short username kudu)
I20260929 06:42:33.581597 6156 webserver.cc:460] Webserver started at http://127.15.157.189:33267/ using document root <none> and password file <none>
I20260929 06:42:33.581815 6156 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:33.581857 6156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:33.581995 6156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:33.583081 6156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/data/instance:
uuid: "1e4f1008601f43e5b124d593d63b0da0"
format_stamp: "Formatted at 2026-09-29 06:42:33 on dist-test-slave-ltw5"
server_key: "38d9024e00a7f554d2b4378896b864f5"
server_key_iv: "9ab9bed8c3f33c55fc087b2c22ce105a"
server_key_version: "encryptionkey@0"
I20260929 06:42:33.583446 6156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/wal/instance:
uuid: "1e4f1008601f43e5b124d593d63b0da0"
format_stamp: "Formatted at 2026-09-29 06:42:33 on dist-test-slave-ltw5"
server_key: "38d9024e00a7f554d2b4378896b864f5"
server_key_iv: "9ab9bed8c3f33c55fc087b2c22ce105a"
server_key_version: "encryptionkey@0"
I20260929 06:42:33.584966 6156 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:42:33.585736 6171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:33.585928 6156 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:33.586040 6156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/wal
uuid: "1e4f1008601f43e5b124d593d63b0da0"
format_stamp: "Formatted at 2026-09-29 06:42:33 on dist-test-slave-ltw5"
server_key: "38d9024e00a7f554d2b4378896b864f5"
server_key_iv: "9ab9bed8c3f33c55fc087b2c22ce105a"
server_key_version: "encryptionkey@0"
I20260929 06:42:33.586122 6156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:33.594079 6149 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } attempt: 2
I20260929 06:42:33.594455 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.594335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:41355 (local address 127.0.0.1:54860)
0929 06:42:33.594392 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.594429 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:41355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 06:42:33.594847 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.594765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:41355 (local address 127.0.0.1:54876)
0929 06:42:33.594808 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.594832 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.189:41355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 06:42:33.594954 6149 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.189:41355: Network error: Client connection negotiation failed: client connection to 127.15.157.189:41355: connect: Connection refused (error 111)
I20260929 06:42:33.598567 6156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:33.600275 6156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:33.600376 6156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:33.604326 6156 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.189:41355
I20260929 06:42:33.604355 6223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.189:41355 every 8 connection(s)
I20260929 06:42:33.604684 6156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/data/info.pb
I20260929 06:42:33.605466 6224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:33.607003 6224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.189@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:33.613169 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 6156
I20260929 06:42:33.613313 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-1/wal/instance
I20260929 06:42:33.613543 15990 external_mini_cluster.cc:1428] Setting key 12f328642a8ddf7ef89e1da2bc924edf
I20260929 06:42:33.615888 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.607677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55084 (local address 127.15.157.190:45379)
0929 06:42:33.607742 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.607744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.607951 (+ 207us) server_negotiation.cc:407] Connection header received
0929 06:42:33.608461 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.608462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.608476 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.608539 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.609135 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.609615 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.610667 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.610868 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.610957 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.612844 (+ 1887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.612846 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.612846 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.612852 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.614542 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.614917 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.614918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.614918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.614988 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.615293 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.615293 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.615293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.615392 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.615444 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.615766 (+ 322us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.615827 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 06:42:33.616174 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.607672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45379 (local address 127.0.0.1:55084)
0929 06:42:33.607837 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.607870 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:33.608358 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:33.608608 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:33.608612 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:33.608849 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:33.609030 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.609034 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.609717 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.609718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.610564 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.610567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.610978 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.610979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.611097 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.611521 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:33.611528 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:33.612762 (+ 1234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:33.614628 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.614634 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.614636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.614842 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.615068 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.615069 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.615070 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.615219 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.615458 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:33.615464 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:33.615632 (+ 168us) client_negotiation.cc:769] Sending connection context
0929 06:42:33.615750 (+ 118us) client_negotiation.cc:240] Negotiation successful
0929 06:42:33.615918 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":71,"threads_started":1}
I20260929 06:42:33.616775 6224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.189@KRBTEST.COM for kudu/127.15.157.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.157.188@KRBTEST.COM; defaulting to no policy
I20260929 06:42:33.624315 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.617043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:41355 (local address 127.0.0.1:54886)
0929 06:42:33.617102 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.617111 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:33.617154 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:33.617425 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:33.617426 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:33.617595 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:33.617656 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.617658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.618913 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.618914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.619386 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.619388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.620051 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.620052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.620101 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.620494 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:33.620498 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:33.621876 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:33.623388 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.623388 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.623389 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.623544 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.623723 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.623723 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.623723 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.623771 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.624056 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:33.624057 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:33.624098 (+ 41us) client_negotiation.cc:769] Sending connection context
0929 06:42:33.624167 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 06:42:33.624237 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.157.188@KRBTEST.COM" created.
I20260929 06:42:33.624495 6228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.617113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54886 (local address 127.15.157.189:41355)
0929 06:42:33.617265 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.617269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.617284 (+ 15us) server_negotiation.cc:407] Connection header received
0929 06:42:33.617300 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.617301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.617311 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.617406 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.617749 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.618833 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.619469 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.619949 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.620057 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.621958 (+ 1901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.621967 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.621968 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.621974 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.623317 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.623614 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.623616 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.623617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.623667 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.623823 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.623824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.623824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.623971 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.624031 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.624205 (+ 174us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.624297 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":129,"thread_start_us":85,"threads_started":1}
I20260929 06:42:33.625113 6224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:42:33.625414 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.625326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:44823 (local address 127.0.0.1:58658)
0929 06:42:33.625357 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.625396 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260929 06:42:33.625574 6173 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
I20260929 06:42:33.626073 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.625932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:44823 (local address 127.0.0.1:58674)
0929 06:42:33.625993 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.626047 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260929 06:42:33.626192 6224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:44823: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.157.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.188.keytab.
Entry for principal kudu/127.15.157.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.188.keytab.
I20260929 06:42:33.639218 15990 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska4I_r0/build/release/bin/kudu
/tmp/dist-test-taska4I_r0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.188:44823
--webserver_interface=127.15.157.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.188.keytab
--principal=kudu/127.15.157.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.157.148:36201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.157.190:45379,127.15.157.189:41355,127.15.157.188:44823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:42:33.675441 6224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } attempt: 1
I20260929 06:42:33.675964 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.675814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:44823 (local address 127.0.0.1:58676)
0929 06:42:33.675893 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.675926 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260929 06:42:33.676405 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.676313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:44823 (local address 127.0.0.1:58684)
0929 06:42:33.676360 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.676387 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260929 06:42:33.676541 6224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:44823: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
I20260929 06:42:33.686103 6149 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } attempt: 3
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for kudu/127.15.157.189@KRBTEST.COM
I20260929 06:42:33.699002 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.686402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:41355 (local address 127.0.0.1:54892)
0929 06:42:33.686463 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.686474 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:33.686552 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:33.686712 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:33.686713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:33.686877 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:33.686938 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.686939 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.687631 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.687633 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.688254 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.688257 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.688711 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.688712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.688817 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.694633 (+ 5816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:33.694640 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:33.696080 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:33.697973 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.697974 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.697974 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.698213 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.698422 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.698423 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.698423 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.698480 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.698743 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:33.698744 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:33.698785 (+ 41us) client_negotiation.cc:769] Sending connection context
0929 06:42:33.698841 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 06:42:33.698918 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 06:42:33.699054 6228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.686482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54892 (local address 127.15.157.189:41355)
0929 06:42:33.686548 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.686550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.686561 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:42:33.686624 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.686625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.686638 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.686708 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.687017 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.687538 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.688351 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.688579 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.688661 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.696185 (+ 7524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.696187 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.696187 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.696195 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.697861 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.698288 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.698289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.698290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.698353 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.698539 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.698540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.698540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.698680 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.698745 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.698880 (+ 135us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.698961 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 06:42:33.699476 6149 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:42:33.699841 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.699735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:44823 (local address 127.0.0.1:58698)
0929 06:42:33.699785 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.699819 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 06:42:33.700206 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.700111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:44823 (local address 127.0.0.1:58714)
0929 06:42:33.700168 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.700192 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260929 06:42:33.700307 6149 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:44823: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
W20260929 06:42:33.721218 6231 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 06:42:33.721415 6231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:42:33.721432 6231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:42:33.721452 6231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:42:33.722607 6231 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:42:33.722654 6231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:42:33.722669 6231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:42:33.722681 6231 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:42:33.722694 6231 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:42:33.724118 6231 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.157.148:36201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.157.190:45379,127.15.157.189:41355,127.15.157.188:44823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/krb5kdc/kudu_127.15.157.188.keytab
--principal=kudu/127.15.157.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.157.188:44823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.157.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:42:33.724300 6231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:42:33.724459 6231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:42:33.729111 6236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:33.729100 6237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:42:33.729108 6239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:42:33.729375 6231 server_base.cc:1034] running on GCE node
I20260929 06:42:33.729647 6231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:42:33.729882 6231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:42:33.731017 6231 hybrid_clock.cc:648] HybridClock initialized: now 1790664153731003 us; error 34 us; skew 500 ppm
I20260929 06:42:33.731487 6149 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } attempt: 1
I20260929 06:42:33.731935 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.731775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:44823 (local address 127.0.0.1:58728)
0929 06:42:33.731858 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.731896 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260929 06:42:33.732316 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.732214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:44823 (local address 127.0.0.1:58734)
0929 06:42:33.732260 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.732287 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260929 06:42:33.732436 6149 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:44823: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:42:33.733752 6231 init.cc:377] Logged in from keytab as kudu/127.15.157.188@KRBTEST.COM (short username kudu)
I20260929 06:42:33.734285 6231 webserver.cc:460] Webserver started at http://127.15.157.188:46537/ using document root <none> and password file <none>
I20260929 06:42:33.734514 6231 fs_manager.cc:359] Metadata directory not provided
I20260929 06:42:33.734558 6231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:42:33.734712 6231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:42:33.735760 6231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/data/instance:
uuid: "f18c4afe7e16435898318f40d8b7c3e4"
format_stamp: "Formatted at 2026-09-29 06:42:33 on dist-test-slave-ltw5"
server_key: "f3965d608f275a2042aeb9b731fe4b1b"
server_key_iv: "2a6778a4f108760c937e37726f80a175"
server_key_version: "encryptionkey@0"
I20260929 06:42:33.736114 6231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/wal/instance:
uuid: "f18c4afe7e16435898318f40d8b7c3e4"
format_stamp: "Formatted at 2026-09-29 06:42:33 on dist-test-slave-ltw5"
server_key: "f3965d608f275a2042aeb9b731fe4b1b"
server_key_iv: "2a6778a4f108760c937e37726f80a175"
server_key_version: "encryptionkey@0"
I20260929 06:42:33.737417 6231 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:42:33.738190 6246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:42:33.738361 6231 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:42:33.738457 6231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/data,/tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/wal
uuid: "f18c4afe7e16435898318f40d8b7c3e4"
format_stamp: "Formatted at 2026-09-29 06:42:33 on dist-test-slave-ltw5"
server_key: "f3965d608f275a2042aeb9b731fe4b1b"
server_key_iv: "2a6778a4f108760c937e37726f80a175"
server_key_version: "encryptionkey@0"
I20260929 06:42:33.738538 6231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:42:33.744699 6224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } attempt: 2
I20260929 06:42:33.745076 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.744956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:44823 (local address 127.0.0.1:58744)
0929 06:42:33.745014 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.745050 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260929 06:42:33.745378 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.745291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:44823 (local address 127.0.0.1:58750)
0929 06:42:33.745334 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.745358 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 06:42:33.745522 6224 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.157.188:44823: Network error: Client connection negotiation failed: client connection to 127.15.157.188:44823: connect: Connection refused (error 111)
I20260929 06:42:33.766376 6231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:42:33.768412 6231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:42:33.768580 6231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:42:33.772845 6231 rpc_server.cc:307] RPC server started. Bound to: 127.15.157.188:44823
I20260929 06:42:33.772953 6298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.157.188:44823 every 8 connection(s)
I20260929 06:42:33.773278 6231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/data/info.pb
I20260929 06:42:33.773758 15990 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska4I_r0/build/release/bin/kudu as pid 6231
I20260929 06:42:33.773885 15990 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska4I_r0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663890058284-15990-0/minicluster-data/master-2/wal/instance
I20260929 06:42:33.774139 15990 external_mini_cluster.cc:1428] Setting key d9bc774aa50d700a6884939d1bd46131
I20260929 06:42:33.774360 6299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:42:33.776342 6299 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.188@KRBTEST.COM
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.188@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:33.784740 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.777028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55098 (local address 127.15.157.190:45379)
0929 06:42:33.777079 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.777089 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.777203 (+ 114us) server_negotiation.cc:407] Connection header received
0929 06:42:33.777255 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.777256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.777265 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.777316 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.777805 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.778526 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.779441 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.779637 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.779726 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.781938 (+ 2212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.781940 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.781941 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.781948 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.783523 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.783923 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.783924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.783925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.783981 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.784194 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.784195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.784196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.784312 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.784388 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.784574 (+ 186us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.784658 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 06:42:33.784741 6303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.776927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.190:45379 (local address 127.0.0.1:55098)
0929 06:42:33.777084 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.777131 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:33.777199 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:33.777347 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:33.777349 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:33.777662 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:33.777725 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.777727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.778605 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.778606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.779357 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.779359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.779749 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.779750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.779821 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.780279 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:33.780287 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:33.781866 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:33.783627 (+ 1761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.783634 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.783636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.783834 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.784054 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.784056 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.784056 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.784129 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.784378 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:33.784384 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:33.784432 (+ 48us) client_negotiation.cc:769] Sending connection context
0929 06:42:33.784542 (+ 110us) client_negotiation.cc:240] Negotiation successful
0929 06:42:33.784658 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
I20260929 06:42:33.784740 6302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.774632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58760 (local address 127.15.157.188:44823)
0929 06:42:33.774814 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.774824 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.774855 (+ 31us) server_negotiation.cc:407] Connection header received
0929 06:42:33.775403 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.775410 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.775456 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.775604 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.776242 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.777445 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.778426 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.778980 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.779089 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.781475 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.781482 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.781483 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.781491 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.783248 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.783581 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.783584 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.783585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.783667 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.783875 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.783876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.783877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.784099 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.784246 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.784374 (+ 128us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.784502 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
I20260929 06:42:33.785956 6299 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.188@KRBTEST.COM for kudu/127.15.157.189@KRBTEST.COM
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.190@KRBTEST.COM
I20260929 06:42:33.792726 6228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.786298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54896 (local address 127.15.157.189:41355)
0929 06:42:33.786350 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.786352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.786360 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:42:33.786384 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.786385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.786394 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.786453 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.786745 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.787203 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.787868 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.788093 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.788177 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.790076 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.790077 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.790078 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.790084 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.791652 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.791952 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.791953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.791954 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.792013 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.792198 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.792198 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.792199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.792343 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.792413 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.792562 (+ 149us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.792627 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:42:33.792753 6303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.786224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.189:41355 (local address 127.0.0.1:54896)
0929 06:42:33.786270 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.786280 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:33.786315 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:33.786460 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:33.786460 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:33.786611 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:33.786655 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.786657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.787279 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.787280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.787769 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.787770 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.788178 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.788179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.788249 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.788702 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:33.788707 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:33.789961 (+ 1254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:33.791729 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.791730 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.791730 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.791884 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.792091 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.792092 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.792092 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.792139 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.792417 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:33.792418 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:33.792463 (+ 45us) client_negotiation.cc:769] Sending connection context
0929 06:42:33.792543 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 06:42:33.792636 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 06:42:33.793097 6299 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:42:33.793754 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.786118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55108 (local address 127.15.157.190:45379)
0929 06:42:33.786157 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.786159 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.786166 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:42:33.786183 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.786185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.786198 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.786261 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.786774 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.787223 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.787899 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.788084 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.788170 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.790861 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.790863 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.790863 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.790884 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.792346 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.792718 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.792719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.792720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.792957 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.793179 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.793180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.793180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.793323 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.793529 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.793571 (+ 42us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.793664 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.188@KRBTEST.COM for kudu/127.15.157.188@KRBTEST.COM
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.157.189@KRBTEST.COM
I20260929 06:42:33.800143 6303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.793358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:44823 (local address 127.0.0.1:58774)
0929 06:42:33.793406 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.793416 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:33.793464 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:33.793574 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:33.793575 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:33.793714 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:33.793746 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.793748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.794620 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.794621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.795351 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.795353 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.795853 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.795854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.795909 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.796255 (+ 346us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:33.796259 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:33.797415 (+ 1156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:33.799118 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.799119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.799119 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.799280 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.799492 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.799493 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.799493 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.799546 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.799804 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:33.799805 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:33.799840 (+ 35us) client_negotiation.cc:769] Sending connection context
0929 06:42:33.799908 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 06:42:33.800005 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260929 06:42:33.800187 6302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.793432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58774 (local address 127.15.157.188:44823)
0929 06:42:33.793481 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.793482 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.793489 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:42:33.793508 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.793509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.793518 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.793569 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.793829 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.794545 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.795441 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.795781 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.795834 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.797507 (+ 1673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.797508 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.797508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.797514 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.799018 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.799369 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.799371 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.799371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.799419 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.799635 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.799636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.799637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.799741 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.799813 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.799935 (+ 122us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.800053 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":32}
I20260929 06:42:33.801527 6299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4: Bootstrap starting.
I20260929 06:42:33.802177 6228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.794421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54902 (local address 127.15.157.189:41355)
0929 06:42:33.794454 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.794456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.794462 (+ 6us) server_negotiation.cc:407] Connection header received
0929 06:42:33.794482 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.794483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.794490 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.794554 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.795107 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.795637 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.796502 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.796696 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.796779 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.799294 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.799296 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.799296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.799303 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.801064 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.801411 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.801412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.801412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.801466 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.801647 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.801648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.801648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.801751 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.801931 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.801969 (+ 38us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.802083 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:42:33.802611 6299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:33.802944 6299 log.cc:824] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:33.803825 6299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4: No bootstrap required, opened a new log
I20260929 06:42:33.803836 15990 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:42:33.805011 6123 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "1bb40818fda84856b05d531a44d8d7d9"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55108
I20260929 06:42:33.805926 6299 raft_consensus.cc:348] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } }
I20260929 06:42:33.806103 6299 raft_consensus.cc:729] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f18c4afe7e16435898318f40d8b7c3e4, State: Initialized, Role: FOLLOWER
I20260929 06:42:33.806197 6299 consensus_queue.cc:260] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } }
I20260929 06:42:33.806465 6305 sys_catalog.cc:455] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } } }
I20260929 06:42:33.806525 6299 sys_catalog.cc:564] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:33.806579 6305 sys_catalog.cc:458] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:42:33.807538 6149 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } attempt: 2
W20260929 06:42:33.808416 6316 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:42:33.808475 6316 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:42:33.808837 6231 master_runner.cc:186] Error getting master registration for 127.15.157.190:45379: OK, instance_id { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" instance_seqno: 1790664153460145 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 06:42:33.811621 6231 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.190@KRBTEST.COM for kudu/127.15.157.188@KRBTEST.COM
I20260929 06:42:33.814939 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.807781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:44823 (local address 127.0.0.1:58780)
0929 06:42:33.807829 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.807841 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:33.807914 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:33.808077 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:33.808079 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:33.808265 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:33.808311 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.808313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.809160 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.809161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.809679 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.809680 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.810154 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.810155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.810224 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.810671 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:33.810676 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:33.812104 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:33.813737 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.813738 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.813739 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.813976 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.814247 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.814248 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.814248 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.814319 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.814623 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:33.814624 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:33.814673 (+ 49us) client_negotiation.cc:769] Sending connection context
0929 06:42:33.814746 (+ 73us) client_negotiation.cc:240] Negotiation successful
0929 06:42:33.814843 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260929 06:42:33.814944 6302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.807867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58780 (local address 127.15.157.188:44823)
0929 06:42:33.807901 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.807902 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.807911 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:42:33.807969 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.807970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.807979 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.808033 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.808381 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.809077 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.809771 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.810088 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.810157 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.812196 (+ 2039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.812197 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.812198 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.812205 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.813662 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.814092 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.814093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.814093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.814175 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.814389 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.814389 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.814389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.814548 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.814613 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.814780 (+ 167us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.814852 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 06:42:33.816439 6149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9: Bootstrap starting.
I20260929 06:42:33.817150 6149 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:33.817423 6149 log.cc:824] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:33.818351 6149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9: No bootstrap required, opened a new log
I20260929 06:42:33.819722 6149 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } }
I20260929 06:42:33.819861 6149 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bb40818fda84856b05d531a44d8d7d9, State: Initialized, Role: FOLLOWER
I20260929 06:42:33.819939 6149 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } }
I20260929 06:42:33.820176 6319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } } }
I20260929 06:42:33.820245 6149 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:33.820248 6319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:42:33.820329 6123 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 06:42:33.820397 6123 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:33.821151 6123 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } }
I20260929 06:42:33.821372 6123 leader_election.cc:288] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [CANDIDATE]: Term 1 election: Requested vote from peers 1e4f1008601f43e5b124d593d63b0da0 (127.15.157.189:41355), f18c4afe7e16435898318f40d8b7c3e4 (127.15.157.188:44823)
I20260929 06:42:33.821983 6273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1bb40818fda84856b05d531a44d8d7d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f18c4afe7e16435898318f40d8b7c3e4"
W20260929 06:42:33.822136 6330 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260929 06:42:33.822134 6273 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4 [term 0 FOLLOWER]: Advancing to term 1
W20260929 06:42:33.822185 6330 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:42:33.823002 6273 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bb40818fda84856b05d531a44d8d7d9 in term 1.
I20260929 06:42:33.823263 6098 leader_election.cc:302] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bb40818fda84856b05d531a44d8d7d9, f18c4afe7e16435898318f40d8b7c3e4; no voters:
I20260929 06:42:33.823367 6319 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:42:33.823514 6319 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [term 1 LEADER]: Becoming Leader. State: Replica: 1bb40818fda84856b05d531a44d8d7d9, State: Running, Role: LEADER
I20260929 06:42:33.823611 6319 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } }
I20260929 06:42:33.824015 6319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bb40818fda84856b05d531a44d8d7d9. Latest consensus state: current_term: 1 leader_uuid: "1bb40818fda84856b05d531a44d8d7d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } } }
I20260929 06:42:33.824095 6319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:33.823544 6081 master_runner.cc:186] Error getting master registration for 127.15.157.189:41355: OK, instance_id { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" instance_seqno: 1790664153603205 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 06:42:33.825765 6081 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 06:42:33.834156 6338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:42:33.834556 6338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:42:33.836340 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.826049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55122 (local address 127.15.157.190:45379)
0929 06:42:33.826094 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.826097 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.826919 (+ 822us) server_negotiation.cc:407] Connection header received
0929 06:42:33.827021 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.827022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.827031 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.827062 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.827888 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.828626 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.829666 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.829953 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.829994 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.831656 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.831657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.831658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.831665 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.833407 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.833836 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.833837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.833837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.833891 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.834143 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.834144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.834144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.834279 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.834354 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.836074 (+ 1720us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.836216 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:42:33.836735 6224 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } attempt: 3
I20260929 06:42:33.838577 6273 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4 [term 1 FOLLOWER]: Refusing update from remote peer 1bb40818fda84856b05d531a44d8d7d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:42:33.839608 6319 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:42:33.841235 6305 sys_catalog.cc:455] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bb40818fda84856b05d531a44d8d7d9. Latest consensus state: current_term: 1 leader_uuid: "1bb40818fda84856b05d531a44d8d7d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } } }
I20260929 06:42:33.841331 6305 sys_catalog.cc:458] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4 [sys.catalog]: This master's current role is: FOLLOWER
Sep 29 06:42:33 dist-test-slave-ltw5 krb5kdc[6068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790664153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.157.189@KRBTEST.COM for kudu/127.15.157.188@KRBTEST.COM
I20260929 06:42:33.846338 6319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1bb40818fda84856b05d531a44d8d7d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } } }
I20260929 06:42:33.846436 6319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:33.847007 6305 sys_catalog.cc:455] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1bb40818fda84856b05d531a44d8d7d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } } }
I20260929 06:42:33.847116 6305 sys_catalog.cc:458] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:42:33.847020 6302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.826682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58788 (local address 127.15.157.188:44823)
0929 06:42:33.826722 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.826724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.835602 (+ 8878us) server_negotiation.cc:407] Connection header received
0929 06:42:33.835700 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.835701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.835713 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.835742 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.836352 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.837020 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.839764 (+ 2744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.840064 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.840121 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.841677 (+ 1556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.841678 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.841678 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.841686 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.843480 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.846106 (+ 2626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.846107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.846107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.846167 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.846404 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.846405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.846405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.846549 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.846631 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.846832 (+ 201us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.846916 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:42:33.847476 6342 mvcc.cc:205] Tried to move back new op lower bound from 7334560374118359040 to 7334560374062223360. Current Snapshot: MvccSnapshot[applied={T|T < 7334560374118359040}]
I20260929 06:42:33.847769 6228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.826318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54918 (local address 127.15.157.189:41355)
0929 06:42:33.826358 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.826360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.830152 (+ 3792us) server_negotiation.cc:407] Connection header received
0929 06:42:33.830259 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.830260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.830271 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.830320 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.835514 (+ 5194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.836421 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.838123 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.838422 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.838468 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.842720 (+ 4252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.842721 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.842722 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.842730 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.844991 (+ 2261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.845403 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.845404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.845404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.845457 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.845976 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.845977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.845977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.846138 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.846336 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.847354 (+ 1018us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.847515 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:42:33.848201 6344 mvcc.cc:205] Tried to move back new op lower bound from 7334560374118359040 to 7334560374062223360. Current Snapshot: MvccSnapshot[applied={T|T < 7334560374118359040}]
I20260929 06:42:33.851830 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.836994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.157.188:44823 (local address 127.0.0.1:58798)
0929 06:42:33.837087 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0929 06:42:33.837097 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:42:33.837149 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:42:33.838296 (+ 1147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:42:33.838297 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:42:33.838463 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:42:33.838500 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.838502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.841158 (+ 2656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.841159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.841934 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:42:33.841937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.843011 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.843012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:42:33.843068 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.843723 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:42:33.843727 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:42:33.845407 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:42:33.850600 (+ 5193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.850601 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.850602 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.850809 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.851076 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:42:33.851077 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:42:33.851078 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:42:33.851175 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:42:33.851475 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:42:33.851477 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:42:33.851528 (+ 51us) client_negotiation.cc:769] Sending connection context
0929 06:42:33.851607 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 06:42:33.851714 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260929 06:42:33.852993 6343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:33.837239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58798 (local address 127.15.157.188:44823)
0929 06:42:33.838128 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.838130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.838138 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:42:33.838170 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.838171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.838193 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.838571 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.838602 (+ 31us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.841047 (+ 2445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.842311 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:33.842607 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:33.845661 (+ 3054us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:33.845703 (+ 42us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:42:33.845704 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:42:33.845704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:42:33.845708 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:42:33.850494 (+ 4786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.850890 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.850891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.850892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.850960 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:42:33.851235 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:42:33.851236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:42:33.851236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:42:33.851363 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:42:33.851447 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:33.851647 (+ 200us) server_negotiation.cc:299] Negotiation successful
0929 06:42:33.851725 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":856,"thread_start_us":93,"threads_started":1}
I20260929 06:42:33.854583 6224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0: Bootstrap starting.
I20260929 06:42:33.855321 6224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0: Neither blocks nor log segments found. Creating new log.
I20260929 06:42:33.855633 6224 log.cc:824] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0: Log is configured to *not* fsync() on all Append() calls
I20260929 06:42:33.856333 6338 catalog_manager.cc:1347] Generated new cluster ID: c0cdd8298ea144a1bbc36a48e9603c98
I20260929 06:42:33.856379 6338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:42:33.856528 6224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0: No bootstrap required, opened a new log
I20260929 06:42:33.858363 6224 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } }
I20260929 06:42:33.858496 6224 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e4f1008601f43e5b124d593d63b0da0, State: Initialized, Role: FOLLOWER
I20260929 06:42:33.858568 6224 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } }
I20260929 06:42:33.858836 6224 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:42:33.858913 6197 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:42:33.859789 6197 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0 [term 1 FOLLOWER]: Refusing update from remote peer 1bb40818fda84856b05d531a44d8d7d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:42:33.860033 6198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1bb40818fda84856b05d531a44d8d7d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1e4f1008601f43e5b124d593d63b0da0"
W20260929 06:42:33.860491 6361 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:42:33.860538 6361 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:42:33.861254 6198 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bb40818fda84856b05d531a44d8d7d9 in term 1.
I20260929 06:42:33.861661 6347 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:42:33.864641 6363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1bb40818fda84856b05d531a44d8d7d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } } }
I20260929 06:42:33.864735 6363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:42:33.864777 6363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1bb40818fda84856b05d531a44d8d7d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } } }
I20260929 06:42:33.864816 6363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:42:33.864952 6366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bb40818fda84856b05d531a44d8d7d9. Latest consensus state: current_term: 1 leader_uuid: "1bb40818fda84856b05d531a44d8d7d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } } }
I20260929 06:42:33.865048 6366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:42:33.873121 6336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1bb40818fda84856b05d531a44d8d7d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb40818fda84856b05d531a44d8d7d9" member_type: VOTER last_known_addr { host: "127.15.157.190" port: 45379 } } peers { permanent_uuid: "1e4f1008601f43e5b124d593d63b0da0" member_type: VOTER last_known_addr { host: "127.15.157.189" port: 41355 } } peers { permanent_uuid: "f18c4afe7e16435898318f40d8b7c3e4" member_type: VOTER last_known_addr { host: "127.15.157.188" port: 44823 } } }
I20260929 06:42:33.873231 6336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9 [sys.catalog]: This master's current role is: LEADER
I20260929 06:42:33.878083 6338 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:42:33.878880 6338 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:42:33.891571 6338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1bb40818fda84856b05d531a44d8d7d9: Generated new TSK 0
I20260929 06:42:33.891791 6338 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 06:42:33.923976 6343 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:33.922350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58802 (local address 127.15.157.188:44823)
0929 06:42:33.922396 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.922398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.923315 (+ 917us) server_negotiation.cc:407] Connection header received
0929 06:42:33.923416 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.923417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.923428 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.923457 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.923911 (+ 454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58802: BlockingRecv error: recv got EOF from 127.0.0.1:58802 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260929 06:42:33.924894 6152 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:33.922601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55138 (local address 127.15.157.190:45379)
0929 06:42:33.922640 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.922641 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.924380 (+ 1739us) server_negotiation.cc:407] Connection header received
0929 06:42:33.924471 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.924473 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.924483 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.924511 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.924817 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55138: BlockingRecv error: recv got EOF from 127.0.0.1:55138 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260929 06:42:33.925905 6228 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:33.923036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54926 (local address 127.15.157.189:41355)
0929 06:42:33.923075 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.923077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.925230 (+ 2153us) server_negotiation.cc:407] Connection header received
0929 06:42:33.925326 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.925327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.925338 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.925366 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.925847 (+ 481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54926: BlockingRecv error: recv got EOF from 127.0.0.1:54926 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260929 06:42:33.928306 6228 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:33.927558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54936 (local address 127.15.157.189:41355)
0929 06:42:33.927604 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.927606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.927803 (+ 197us) server_negotiation.cc:407] Connection header received
0929 06:42:33.927906 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.927907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.927923 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.927953 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.928267 (+ 314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54936: BlockingRecv error: recv got EOF from 127.0.0.1:54936 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260929 06:42:33.931495 6228 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:33.930788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54942 (local address 127.15.157.189:41355)
0929 06:42:33.930819 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.930820 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.931037 (+ 217us) server_negotiation.cc:407] Connection header received
0929 06:42:33.931131 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.931132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.931141 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.931168 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.931454 (+ 286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54942: BlockingRecv error: recv got EOF from 127.0.0.1:54942 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 06:42:33.935518 6228 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:33.934730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54946 (local address 127.15.157.189:41355)
0929 06:42:33.934763 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.934765 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.934970 (+ 205us) server_negotiation.cc:407] Connection header received
0929 06:42:33.935061 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.935062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.935072 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.935168 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.935479 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54946: BlockingRecv error: recv got EOF from 127.0.0.1:54946 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 06:42:33.941613 6228 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:33.940779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54952 (local address 127.15.157.189:41355)
0929 06:42:33.940814 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.940816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.941043 (+ 227us) server_negotiation.cc:407] Connection header received
0929 06:42:33.941141 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.941142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.941153 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.941203 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.941557 (+ 354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54952: BlockingRecv error: recv got EOF from 127.0.0.1:54952 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260929 06:42:33.951881 6228 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:33.951020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54960 (local address 127.15.157.189:41355)
0929 06:42:33.951055 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.951057 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.951330 (+ 273us) server_negotiation.cc:407] Connection header received
0929 06:42:33.951431 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.951433 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.951443 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.951472 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.951829 (+ 357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54960: BlockingRecv error: recv got EOF from 127.0.0.1:54960 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260929 06:42:33.970397 6228 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:33.969368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54962 (local address 127.15.157.189:41355)
0929 06:42:33.969412 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:33.969415 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:33.969718 (+ 303us) server_negotiation.cc:407] Connection header received
0929 06:42:33.969824 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:33.969825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:33.969837 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:33.969868 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:33.970338 (+ 470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54962: BlockingRecv error: recv got EOF from 127.0.0.1:54962 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260929 06:42:34.004607 6228 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:34.003859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54974 (local address 127.15.157.189:41355)
0929 06:42:34.003905 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:34.003907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:34.004034 (+ 127us) server_negotiation.cc:407] Connection header received
0929 06:42:34.004126 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:34.004127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:34.004138 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:34.004185 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:34.004523 (+ 338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54974: BlockingRecv error: recv got EOF from 127.0.0.1:54974 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260929 06:42:34.070477 6228 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:34.069725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54976 (local address 127.15.157.189:41355)
0929 06:42:34.069781 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:34.069783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:34.069853 (+ 70us) server_negotiation.cc:407] Connection header received
0929 06:42:34.069902 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:34.069903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:34.069913 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:34.069982 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:34.070398 (+ 416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54976: BlockingRecv error: recv got EOF from 127.0.0.1:54976 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260929 06:42:34.200573 6228 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:34.199779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54990 (local address 127.15.157.189:41355)
0929 06:42:34.199858 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:34.199861 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:34.199976 (+ 115us) server_negotiation.cc:407] Connection header received
0929 06:42:34.200067 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:34.200068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:34.200086 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:34.200170 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:34.200526 (+ 356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54990: BlockingRecv error: recv got EOF from 127.0.0.1:54990 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260929 06:42:34.458441 6228 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:42:34.457812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54992 (local address 127.15.157.189:41355)
0929 06:42:34.457887 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:34.457888 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:34.457898 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:42:34.457923 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:34.457924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:34.457934 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:34.457986 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:42:34.458352 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54992: BlockingRecv error: recv got EOF from 127.0.0.1:54992 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 06:42:34.808892 6316 catalog_manager.cc:1259] Loaded cluster ID: c0cdd8298ea144a1bbc36a48e9603c98
I20260929 06:42:34.808966 6316 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4: loading cluster ID for follower catalog manager: success
I20260929 06:42:34.809722 6316 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4: acquiring CA information for follower catalog manager: success
I20260929 06:42:34.809957 6316 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f18c4afe7e16435898318f40d8b7c3e4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:42:34.860952 6361 catalog_manager.cc:1259] Loaded cluster ID: c0cdd8298ea144a1bbc36a48e9603c98
I20260929 06:42:34.861030 6361 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0: loading cluster ID for follower catalog manager: success
I20260929 06:42:34.861865 6361 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0: acquiring CA information for follower catalog manager: success
I20260929 06:42:34.862203 6361 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1e4f1008601f43e5b124d593d63b0da0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:42:34.973963 6432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:34.971637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54996 (local address 127.15.157.189:41355)
0929 06:42:34.971784 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:34.971786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:34.971797 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:42:34.971826 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:34.971826 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:34.971874 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:34.971946 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:34.972080 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:34.972569 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:34.973283 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:34.973480 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:34.973529 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:34.973681 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:34.973786 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:34.973844 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:34.973881 (+ 37us) server_negotiation.cc:299] Negotiation successful
0929 06:42:34.973898 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
I20260929 06:42:34.977766 6438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:34.975680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58814 (local address 127.15.157.188:44823)
0929 06:42:34.975798 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:34.975800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:34.975808 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:42:34.975842 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:34.975843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:34.975876 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:34.975940 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:34.976019 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:34.976478 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:34.977146 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:34.977333 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:34.977385 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:34.977506 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:34.977593 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:34.977658 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:34.977691 (+ 33us) server_negotiation.cc:299] Negotiation successful
0929 06:42:34.977706 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":61,"threads_started":1}
I20260929 06:42:34.982374 6445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:34.979345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55150 (local address 127.15.157.190:45379)
0929 06:42:34.979439 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:34.979442 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:34.979453 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:42:34.979571 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:34.979573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:34.979627 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:34.979705 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:34.979915 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:34.980442 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:34.981447 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:34.981743 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:34.981811 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:34.981991 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:34.982149 (+ 158us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:34.982210 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:34.982265 (+ 55us) server_negotiation.cc:299] Negotiation successful
0929 06:42:34.982291 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74,"thread_start_us":43,"threads_started":1}
I20260929 06:42:34.982373 6438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:34.979461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58816 (local address 127.15.157.188:44823)
0929 06:42:34.979503 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:34.979505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:34.979610 (+ 105us) server_negotiation.cc:407] Connection header received
0929 06:42:34.979687 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:34.979688 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:34.979702 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:34.979753 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:34.980009 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:34.980706 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:34.981518 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:34.981854 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:34.981927 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:34.982075 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:34.982103 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:34.982157 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:34.982256 (+ 99us) server_negotiation.cc:299] Negotiation successful
0929 06:42:34.982281 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:42:34.982513 6432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:42:34.979474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55004 (local address 127.15.157.189:41355)
0929 06:42:34.979514 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:42:34.979516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:42:34.979638 (+ 122us) server_negotiation.cc:407] Connection header received
0929 06:42:34.979751 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:42:34.979752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:42:34.979761 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:42:34.979811 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:42:34.979946 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:34.980684 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:34.981725 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:42:34.982001 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:42:34.982089 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:42:34.982268 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:42:34.982295 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:42:34.982323 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0929 06:42:34.982414 (+ 91us) server_negotiation.cc:299] Negotiation successful
0929 06:42:34.982439 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:42:34.984370 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 6081
I20260929 06:42:34.989792 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 6156
I20260929 06:42:34.994673 15990 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska4I_r0/build/release/bin/kudu with pid 6231
2026-09-29T06:42:34Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2796 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5589 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (264943 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST